Page 161 - Building Big Data Applications

160 Building Big Data Applications

Create and update date and time
Processing specifics if any for the field or attribute
Contextual metadatadcontextual metadata is data that sets “context” of your data.
This is more related to processing large objects like text, images, and videos.
Examples of contextual metadata include news feeds, tags on images etc.
Contextual metadata is the hardest to collect.
Process design level metadata
Source table
Target table
Algorithms
Business rules
Exception
Lookup or master data or reference data
Program level metadata
History of transformation changes
Business rules
Source program
System name
Source program author
Extract program name and version
Load scripts
Script specific business rules
Load frequency
Extract dependencies
Transformation dependencies
Load dependencies
Load completion date/time stamp
Load completion record count
Load status
Infrastructure metadata
Source system platform
Source system network address
Source system support contact
Target system platform
Target system network address
Target system support contact
Estimated size (tables/objects)
Core business metadata
Field/object description
Confidence level
Frequency of update
Basic business metadata