Page 16 - Building Big Data Applications

10 Building Big Data Applications

provide us a roadmap to what all happens in one action and its lifeline of activ-
ities from that point forward.
a. Formats
b. Geocodes
c. Language
d. Symbols
e. Acquisition
f. Ingestion
g. Quality
2. PrivacydThe issue of privacy is a very serious concern for all producers of data.
Committees in the United States and European Union are working on defining
privacy guidelines with respect to data in the new world. Evolution always occurs
in stages, and we are now past the infancy stage of the evolution of the Internet
of Things. Watch this space with interest as the data, its types, formats and de-
tails, and the devices evolve over the next decade.
3. SecuritydThis area in the Internet of Things data lifecycle offers an interesting
yes-and-no situation. The yes part is security requirements have been identified;
the no part is these requirements have not been standardized into a set of regula-
tions. This area is emerging rapidly with a great deal of the focus on isolating
data, its transmission and encryption, its storage, and its lifecycle. Several articles
on these topics are available that provide perspectives from the major stake-
holders, and they all have solutions in their stack of offerings in regard to
acquiring and managing data in the world of the Internet of Things.
4. GovernancedIn today’s world, only a handful of companies across the globe have
success in implementing a stellar data governance program. The worry here is
that the remaining companies may have some aspects of a great data governance
program but are hanging by thread in other critical areas. Based on my experi-
ence, I would say that the 30/70 rule applies to a data governance program’s suc-
cess/moderate success. The world of data for the Internet of Things needs more
governance, more discipline and more analytics than ever, but, most important, it
needs a highly managed lifecycle. If rapid resolutions are not achieved in this area
and if it is not made a high priority, the journey for internal and Internet of
Things data could be quite challenging.
5. Analytics in the world we live in surrounds us everywhere. We are getting more
oriented to measure the value of everything we see and this is what the new
world calls as “internet of things”and its driven analytics. We are in the need to
develop an analytic ecosystem that can meet and exceed all the requirements of
the new world of information.
6. Reporting is never going away from the enterprise, but can we get access to all
the data and provide all the details needed in the reports? The answer for a new
ecosystem has to be “yes”. We need to provide a flexible and scalable reporting
system for the enterprise. The goal is not around master data or enterprise data