Define integration and interoperability
Managing the movement and consolidation of data within and between applications and organisations
Deliverables of integration and interoperability
Metrics of integration and interoperability
Integration
movement and consolidation of data into consistent forms
interoperability
providing the mechanisms for multiple systems to process data
goals of integration and interoperability
four common use case of integration and interoperability
RAID
redundant array of inexpensive discs
Styles of integration and interoperability approaches
point to point
hub distrubution
message synchronisation
Bus distrubution
ETL/ELT/CDC
Abstraction / Virtual Consolidation (API)
point to point integration approaches
device linked to device with communications each way between
Point to point advantages
point to point disadvantages
hub distrubution interoperability approach
changes are submitted to a central hub and routes it to the people who are authorised to recieve it
Messaging Bus interoperability approach
application makes a change and then a bus pushes the data into a central service which then pushes it to systems that are authorised to recieve it
Service Oriented Architechture (SOA)
based on bus distrubition
Hub compared to bus model
Bus is more scalable
Concerns of hub and bus model
single point of failure
Integration is…
database to database
ETL acronym
extract transform load
CDC acronym
change data capture (drip)
ETL, ELT
Batch distrubution for the mass movement of data collected over time from source data structure
CDC
event driven distrubution
ETL vs ELT
ETL - higher quality longer time
ELT - lower quality, quicker time (good for data scientists etc, bad because it might get forgotten about)
Message Synchronisation and propagation integration approach
put code in for application to application integration
event driven