Essential PySpark for Scalable Data Analytics

Essential PySpark for Scalable Data Analytics
Author :
Publisher : Packt Publishing Ltd
Total Pages : 322
Release :
ISBN-10 : 9781800563094
ISBN-13 : 1800563094
Rating : 4/5 (94 Downloads)

Book Synopsis Essential PySpark for Scalable Data Analytics by : Sreeram Nudurupati

Download or read book Essential PySpark for Scalable Data Analytics written by Sreeram Nudurupati and published by Packt Publishing Ltd. This book was released on 2021-10-29 with total page 322 pages. Available in PDF, EPUB and Kindle. Book excerpt: Get started with distributed computing using PySpark, a single unified framework to solve end-to-end data analytics at scale Key FeaturesDiscover how to convert huge amounts of raw data into meaningful and actionable insightsUse Spark's unified analytics engine for end-to-end analytics, from data preparation to predictive analyticsPerform data ingestion, cleansing, and integration for ML, data analytics, and data visualizationBook Description Apache Spark is a unified data analytics engine designed to process huge volumes of data quickly and efficiently. PySpark is Apache Spark's Python language API, which offers Python developers an easy-to-use scalable data analytics framework. Essential PySpark for Scalable Data Analytics starts by exploring the distributed computing paradigm and provides a high-level overview of Apache Spark. You'll begin your analytics journey with the data engineering process, learning how to perform data ingestion, cleansing, and integration at scale. This book helps you build real-time analytics pipelines that help you gain insights faster. You'll then discover methods for building cloud-based data lakes, and explore Delta Lake, which brings reliability to data lakes. The book also covers Data Lakehouse, an emerging paradigm, which combines the structure and performance of a data warehouse with the scalability of cloud-based data lakes. Later, you'll perform scalable data science and machine learning tasks using PySpark, such as data preparation, feature engineering, and model training and productionization. Finally, you'll learn ways to scale out standard Python ML libraries along with a new pandas API on top of PySpark called Koalas. By the end of this PySpark book, you'll be able to harness the power of PySpark to solve business problems. What you will learnUnderstand the role of distributed computing in the world of big dataGain an appreciation for Apache Spark as the de facto go-to for big data processingScale out your data analytics process using Apache SparkBuild data pipelines using data lakes, and perform data visualization with PySpark and Spark SQLLeverage the cloud to build truly scalable and real-time data analytics applicationsExplore the applications of data science and scalable machine learning with PySparkIntegrate your clean and curated data with BI and SQL analysis toolsWho this book is for This book is for practicing data engineers, data scientists, data analysts, and data enthusiasts who are already using data analytics to explore distributed and scalable data analytics. Basic to intermediate knowledge of the disciplines of data engineering, data science, and SQL analytics is expected. General proficiency in using any programming language, especially Python, and working knowledge of performing data analytics using frameworks such as pandas and SQL will help you to get the most out of this book.


Essential PySpark for Scalable Data Analytics Related Books

Essential PySpark for Scalable Data Analytics
Language: en
Pages: 322
Authors: Sreeram Nudurupati
Categories: Data mining
Type: BOOK - Published: 2021-10-29 - Publisher: Packt Publishing Ltd

DOWNLOAD EBOOK

Get started with distributed computing using PySpark, a single unified framework to solve end-to-end data analytics at scale Key FeaturesDiscover how to convert
Hands-On Big Data Analytics with PySpark
Language: en
Pages: 172
Authors: Rudy Lai
Categories: Computers
Type: BOOK - Published: 2019-03-29 - Publisher: Packt Publishing Ltd

DOWNLOAD EBOOK

Use PySpark to easily crush messy data at-scale and discover proven techniques to create testable, immutable, and easily parallelizable Spark jobs Key FeaturesW
Spark: The Definitive Guide
Language: en
Pages: 594
Authors: Bill Chambers
Categories: Computers
Type: BOOK - Published: 2018-02-08 - Publisher: "O'Reilly Media, Inc."

DOWNLOAD EBOOK

Learn how to use, deploy, and maintain Apache Spark with this comprehensive guide, written by the creators of the open-source cluster-computing framework. With
Big Data Analytics for Large-Scale Multimedia Search
Language: en
Pages: 372
Authors: Stefanos Vrochidis
Categories: Technology & Engineering
Type: BOOK - Published: 2019-05-28 - Publisher: John Wiley & Sons

DOWNLOAD EBOOK

A timely overview of cutting edge technologies for multimedia retrieval with a special emphasis on scalability The amount of multimedia data available every day
Data Analysis with Python and PySpark
Language: en
Pages: 454
Authors: Jonathan Rioux
Categories: Computers
Type: BOOK - Published: 2022-03-22 - Publisher: Simon and Schuster

DOWNLOAD EBOOK

Think big about your data! PySpark brings the powerful Spark big data processing engine to the Python ecosystem, letting you seamlessly scale up your data tasks