Big Data Management

AY2021/2022 Semester 2

We are in the 'Big Data' era - an extremely large amount of data is created every day. The world of data management has dramatically changed in the 'Big Data' era. This is primarily driven by multiple factors including cheaper storage costs, increasing availability of sensors, smart devices, social software, and availability of cloud computing infrastructure, and cheaper processing cost of large volumes of data due to dramatic advances in modern hardware (e.g., solid state disk, multicore CPUs, large memory). This seismic impact of big data has led to increasing demand in building scalable data infrastructures toward supporting real-world applications. This course aims to provide a broad understanding of big data and current technologies in managing and processing them. Key topics covered in this course include general principles of designing big data systems, distributed storage of big data, programming models in big data, big data analytics techniques, key-value stores, and big data analytics. Upon completion of this course, you will learn to evaluate issues associated with big data management and business data analytics, learn how the data is stored in a distributed file system and how queries and analytics run in parallel.