Page 176 - Building Big Data Applications

10

Building the big data application

Storyboard development is the first task for developing all applications and associated
outcomes, features, transformations, visualization, usage, exploration of data, and other
details. The storyboard has to be built based on the following:
Business use case that has led to the build of the application. The trick here is to
not follow the business thought but develop an application flow that will mimic
the business thought using storyboard features, data, and logical flow.
Logical flows that transform data with appropriate business rules and research
rules as “applied.iden”
Log and lineage data collection.
Requirements for repeatability, pause and proceed, and stop of the flow if needed.
Conceptual process flows for the steps to be built for the application.
Visualization requirements and conceptual models of screens as drawn manually.
Security requirements.
Fault tolerance and recovery from failure requirements.

This storyboard session will need to be done for each step of the application, which
will be useful to determine the programming and development process. There will be
features that will be core to the application and used as master library of functionality.
These libraries will need to be segmented as core and their application is across multiple
touchpoints and this needs to be added to the governance process to prevent chaos later
if and when changes are needed to be made and they affect users who did not request for
additions or modifications. These are foundational elements that can be defined and
processed throughout the lifecycle of the application. Each storyboard will need the
following data to be collected and mandated as necessary:
Storyboard project name
Storyboard application name
Storyboard id
Storyboard date
Storyboard participants
Storyboard requirements
Storyboard data
Storyboard transformations
Storyboard compute
Storyboard error messages
Storyboard error handling
Storyboard governance requirements

Building Big Data Applications. https://doi.org/10.1016/B978-0-12-815746-6.00010-7 175
Copyright © 2020 Elsevier Inc. All rights reserved.