eBooks-it.org Logo
eBooks-IT.org Inner Image

Fast Data Processing with Spark

Fast Data Processing with Spark Image

Book Details:

Publisher:Packt Publishing
Series: Packt
Author:Holden Karau
Edition:1
ISBN-10:1782167064
ISBN-13:9781782167068
Pages:120
Published:Oct 23 2013
Posted:Nov 19 2014
Language:English
Book format:PDF
Book size:8.14 MB

Book Description:

High-speed distributed computing made easy with Spark Overview Implement Spark's interactive shell to prototype distributed applications Deploy Spark jobs to various clusters such as Mesos, EC2, Chef, YARN, EMR, and so on Use Shark's SQL query-like syntax with Spark In Detail Spark is a framework for writing fast, distributed programs. Spark solves similar problems as Hadoop MapReduce does but with a fast in-memory approach and a clean functional style API. With its ability to integrate with Hadoop and inbuilt tools for interactive query analysis (Shark), large-scale graph processing and analysis (Bagel), and real-time analysis (Spark Streaming), it can be interactively used to quickly process and query big data sets. Fast Data Processing with Spark covers how to write distributed map reduce style programs with Spark. The book will guide you through every step required to write effective distributed programs from setting up your cluster and interactively exploring the API, to deploying your job to the cluster, and tuning it for your purposes. Fast Data Processing with Spark covers everything from setting up your Spark cluster in a variety of situations (stand-alone, EC2, and so on), to how to use the interactive shell to write distributed code interactively. From there, we move on to cover how to write and deploy distributed jobs in Java, Scala, and Python. We then examine how to use the interactive shell to quickly prototype distributed programs and explore the Spark API. We also look at how to use Hive with Spark to use a SQL-like query syntax with Shark, as well as manipulating resilient distributed datasets (RDDs). What you will learn from this book Prototype distributed applications with Spark's interactive shell Learn different ways to interact with Spark's distributed representation of data (RDDs) Load data from the various data sources Query Spark with a SQL-like query syntax Integrate Shark queries with Spark programs Effectively test your distributed software Tune a Spark installation Install and set up Spark on your cluster Work effectively with large data sets Approach This book will be a basic, step-by-step tutorial, which will help readers take advantage of all that Spark has to offer. Who this book is written for Fast Data Processing with Spark is for software developers who want to learn how to write distributed programs with Spark. It will help developers who have had problems that were too much to be dealt with on a single computer. No previous experience with distributed programming is necessary. This book assumes knowledge of either Java, Scala, or Python.

Download Link:

Related Books:

Fast Data Processing with Spark

Fast Data Processing with Spark Image
2nd Edition
Fast Data Processing with Spark - Second Edition is for software developers who want to learn how to write distributed programs with Spark. It will help developers who have had problems that were too big to be dealt with on a single computer. No previous experience with distributed programming is necessary. This book assumes knowledge of either Java, Scala, or Python....

Advanced Analytics with Spark

Patterns for Learning from Data at Scale
Advanced Analytics with Spark Image
Apache Spark is emerging as one of the most popular technologies for performing analytics on huge datasets, and this practical guide shows you how to harness Spark';s power for approaching a variety of analytics problems. You';ll learn how to apply common techniques, such as classification, clustering, collaborative filtering, anomaly detection, dimensionality reduction, and Monte Carlo simulation to fields such as genomics, security, and finance.Advanced Analytics with Spark supplies complete implementations that analyze large public datasets, and acts as an introduction to using these techniques and other best practices in Spark programming.Become familiar with the Spark programming model and ecosystemLearn general approaches in data scienceDiscove...

PHP Oracle Web Development

Data processing, Security, Caching, XML, Web Services, and Ajax
PHP Oracle Web Development Image
This practical book is built entirely around example code, covering the most popular and up-to-date topics on using PHP in conjunction with Oracle. The book explains in extensive detail how to build robust, efficient, and secure PHP/Oracle solutions. Although this book covers only the most popular and up-to-date topic areas on the use of PHP in conjunction with Oracle, the author does not make any assumption about the skill level of the reader. Packed with information in an easy-to-read format, the book is ideal for any PHP developer who deals with Oracle....



2007 - 2021 © eBooks-IT.org