Splunk

Splunk手册学习之Knowledge Manager Manual-5

3.2.manage and explore datasets

Dataset types and usage
Dataset types:

  • Lookups
  • Data model datasets
  • Table datasets

Manage datasets
search app -> datasets -> specify dataset
view dataset

  • In the Search & Reporting app, click Datasets to open the Datasets listing page.
  • Find a dataset that you want to review
  • Click the > symbol in the first column to expand the row of the dataset details

Visualize a dataset with Pivot

  • In the Search & Reporting app, click Datasets
  • Find a dataset that you want to work with in Pivot
  • Select Explore > Visualize with Pivot

3.3.creating data models

About data models
In building a typical data model, knowledge managers use knowledge object types such as lookups, transactions, search-time field extractions, and calculated fields

what is data model?
To create an effective data model, you must understand your data sources and your data semantics
Data model datasets can get their fields from custom field extractions that you have defined. Data model datasets can get additional fields at search time through regular-expression-based field extractions, lookups, and eval expression

relationship between data models, data model datasets, and searches in the following subsections
Data models generate searches:

  • Dataset constraints determine the first part of the search through
    1、Simple search filters (Root event datasets and all child datasets).
    2、Complex search strings (Root search datasets)
    3、transaction definitions (Root transaction datasets).

The fields you select are added to the search that the dataset generates
The fields can include calculated fields, user-defined field extractions, and fields added to your data by lookups


Datasets
Root datasets can be defined by a search constraint, a search, or a transaction

  • Root event datasets
    the most commonly-used type of root data model dataset
  • Root search datasets
    define a base dataset that includes one or more fields that aggregate over the entire dataset
  • Root transaction datasets
    Before you create a transaction dataset you must already have some event or search dataset trees in your model.

data model acceleration
To accelerate a data model, it must contain at least one root event dataset, or one root search dataset that only uses streaming commands. Acceleration only affects these dataset types and datasets that are children of those root datasets. You cannot accelerate root search datasets that use nonstreaming commands (including transforming commands), root transaction datasets, and children of those datasets. Data models can contain a mixture of accelerated and unaccelerated datasets.


Dataset constraints

  • For a root event dataset or a child dataset of any type, the constraint looks like a simple search, without additional pipes and search commands
  • For a root search dataset, the constraint is the dataset search string
  • For a root transaction dataset, the constraint is the transaction definition

Dataset field types

  • Auto-extracted
    You can only add auto-extracted fields to root datasets,Child datasets can inherit them, but they cannot add new auto-extracted fields of their own. Auto-extracted fields divide into three groups
    07a1
  • Eval Expression
  • Lookup
  • Regular Expression
  • Geo IP

Field categories
The Data Model Editor groups data model dataset fields into three categories
07a2


Field inheritance
All data model datasets have inherited fields
Root event, search, and transaction datasets also have inherited fields. These inherited fields are default fields that are extracted from every event, such as _time, host, source, and sourcetype.

支付宝扫码打赏 微信打赏

若你觉得我的文章对你有帮助,欢迎点击上方按钮对我打赏

扫描二维码,分享此文章

linuxwt's Picture
linuxwt

我叫王腾,来自武汉,2016年毕业后在上海做了一年helpdesk,自学了linux后回武汉从事系统运维的工作,从2017年开始写博客记录自己的学习工作,现在正在进行数据迁移到此博客,目前就职于北京神州新桥科技有限公司,个人的座右铭是:逃脱舒适区才能在闲暇的时候惬意的玩耍。

武汉光谷 https://linuxwt.com

Subscribe to 今晚打老虎

Get the latest posts delivered right to your inbox.

or subscribe via RSS with Feedly!

Comments