- Data Management
- Summary
Course Syllabus
Obiettivi
At theend of the module students will be able define and realize a complete data pipeline from data acquisition to data storage (relational or not) according to their application needs
Students will be able to evalute for each step the approrpiate tool to use
Contenuti sintetici
Introduction to data management in big data context
data life cycle
data acquisition techniques
data modelling and storage
data preparation, cleansing, quality and explorative data analysis
advance data management concepts
Programma esteso
- Data life cycle
- data acquisition
- web scraping
- rest api
- real time data acquisition
- use of LLM
- data storage and modelling
- Introduction to NoSQL models
- key value and columnar models
- Document based system
- Graph db
6.data preparation, cleansing, quality and explorative data analysis - Data integration
- Data quality
- Advanced data management concepts
- data warehouse
- data lake
Prerequisiti
knowledge of relational model
Modalità didattica
Lectures and exercises in the classroom and on virtual lab
Lectures with the support of slideware, discussion of practical cases through the forum, discussion of practical home-work projects.
Some self-assessment tests, not considered for the final evaluation will be provided
Materiale didattico
G. Harrison Next Generation Databases, Apress, 2015
A. Rezzani Big data analytics Apogeo 2017
Yau, N. (2011). Visualize this: the FlowingData guide to design, visualization, and statistics. John Wiley & Sons.
Ware, C. (2012). Information visualization: perception for design. Elsevier.
Scientific articles and class pack provided by the lecturers.
Periodo di erogazione dell'insegnamento
first semester
Modalità di verifica del profitto e valutazione
The exam is divided into two parts
Data Management (50% of the final evaluation): Written exam and a project related to the topic of the module
Data visualization(50% of the final evaluation): test and a project related to the topic of the module
Orario di ricevimento
Please send an e-mail to teachers to arrange an appointment
Sustainable Development Goals
Aims
At theend of the module students will be able define and realize a complete data pipeline from data acquisition to data storage (relational or not) according to their application needs
Students will be able to evalute for each step the approrpiate tool to use
Contents
Introduction to data management in big data context
data life cycle
data acquisition techniques
data modelling and storage
data preparation, cleansing, quality and explorative data analysis
advance data management concepts
Detailed program
- Data life cycle
- data acquisition
- web scraping
- rest api
- real time data acquisition
- use of LLM
- data storage and modelling
- Introduction to NoSQL models
- key value and columnar models
- Document based system
- Graph db
6.data preparation, cleansing, quality and explorative data analysis - Data integration
- Data quality
- Advanced data management concepts
- data warehouse
- data lake
Prerequisites
knowledge of relational model
Teaching form
Lectures and exercises in the classroom and on virtual lab
Lectures with the support of slideware, discussion of practical cases through the forum, discussion of practical home-work projects.
Someelf-assessment tests, not considered for the final evaluation will be provided
Textbook and teaching resource
G. Harrison Next Generation Databases, Apress, 2015
A. Rezzani Big data analytics Apogeo 2017
Yau, N. (2011). Visualize this: the FlowingData guide to design, visualization, and statistics. John Wiley & Sons.
Ware, C. (2012). Information visualization: perception for design. Elsevier.
Scientific articles and class pack provided by the lecturers.
Semester
first semester
Assessment method
The exam is divided into two parts
Data Management (50% of the final evaluation): Written exam and a project related to the topic of the module
Data visualization(50% of the final evaluation): test and a project related to the topic of the module
Office hours
Please send an e-mail to teachers to arrange an appointment