Don't like banners? Log in and we will make sure you see no banners. For free.
A Big Data Hadoop and Spark project for absolute beginners

A Big Data Hadoop and Spark project for absolute beginners

Other
Size
3.7 GB
Seeders
1
Leechers
0
Files
98
Category
Other
Added
at 6:51am GMT+1
Infohash
e54e4cd369563b62cd3d61813146cd18318347d1
Direct linkTorrent fileDownload now
Don't like banners? Log in and we will make sure you see no banners. For free.

Description


Description



Get started with Big Data quickly leveraging free cloud cluster and solving a real world use case!  Learn Hadoop, Hive , Spark (both Python and Scala) from scratch!



Learn to code Spark Scala & PySpark like  a real world developer. Understand real world coding best practices, logging, error handling , configuration management using both Scala and Python.



Project



A bank is launching a new credit card and wants to identify prospects it can target in its marketing campaign.



It has received prospect data from various internal and 3rd party sources. The data has various issues such as missing or unknown values in certain fields. The data needs to be cleansed before any kind of analysis can be done.



Since the data is in huge volume with billions of records, the bank has asked you to use Big Data Hadoop and Spark technology to cleanse, transform and analyze this data.



What you will learn :



   Big Data, Hadoop concepts

   How to create a free Hadoop and Spark cluster using Google Dataproc

   Hadoop hands-on – HDFS, Hive

   Python basics

   PySpark RDD – hands-on

   PySpark SQL, DataFrame – hands-on

   Project work using PySpark and Hive

   Scala basics

   Spark Scala DataFrame

   Project work using Spark Scala

   Spark Scala Real world coding framework and development using Winutil, Maven and IntelliJ.

   Python Spark Hadoop Hive coding framework and development using PyCharm

   Building a data pipeline using Hive , PostgreSQL, Spark

   Logging , error handling and unit testing of PySpark and Spark Scala applications

   Spark Scala Structured Streaming

   Applying spark transformation on data stored in AWS S3 using Glue and viewing data using Athena



Prerequisites :



   Some basic programming skills

   Some knowledge of SQL queries



Who this course is for:



   Beginners who want to learn Big Data or experienced people who want to transition to a Big Data role

   Big data beginners who want to learn how to code in the real world



Requirements



   Students should have some programming background and some knowledge of SQL queries.



Last Updated 12/2020

File list
  • A Big Data Hadoop and Spark project for absolute beginners
  • .pad/0 6 B
  • .pad/1 190.4 KB
  • .pad/2 4.2 KB
  • .pad/3 71.3 KB
  • .pad/4 109.9 KB
  • .pad/5 248.5 KB
  • .pad/6 58 KB
  • .pad/7 235.6 KB
  • .pad/8 833.5 KB
  • TutsNode.com.txt 63 B
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/10.1 Postgres-course-catalog.sql 1.2 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/11.1 Postgres-course-catalog_psql.zip 619 B
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/12.1 FutureXSparkScalaProject_Postgres.zip 12.3 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/14. Organizing code with Objects and Methods.mp4 91.2 MB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/14.1 FutureXSparkScalaProject_organize.zip 108.7 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/15.1 log4j.zip 343 B
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/5.1 ScalaHelloWorld.zip 8 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/6.1 ScalaBasics.zip 12.2 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/7.1 SparkHelloWorld.zip 9.7 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/8.1 githuhb-link.txt 42 B
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/8.2 winutils.zip 36.1 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/9.1 FutureXSparkScalaProject.zip 11.7 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/11. A Data Pipeline with Spark Scala Hadoop PostgreSQL/1. Reading from Hive and Writing to Postgres.mp4 104.1 MB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/11. A Data Pipeline with Spark Scala Hadoop PostgreSQL/1.1 FutureXSparkScalaProject_readHivewritePG.zip 353.5 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/11. A Data Pipeline with Spark Scala Hadoop PostgreSQL/2. Reading Configuration from JSON using Typesafe.mp4 85.1 MB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/11. A Data Pipeline with Spark Scala Hadoop PostgreSQL/2.1 FutureXSparkScalaProject_typesafe_config_parser.zip 358.9 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/11. A Data Pipeline with Spark Scala Hadoop PostgreSQL/3.1 FutureXSparkScalaProject_writeToHive.zip 396.9 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/11. A Data Pipeline with Spark Scala Hadoop PostgreSQL/5. Intellij Maven troubleshooting tips.html 590 B
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/12. Spark Scala Unit Testing using ScalaTest/1.1 FutureXScalaUnitTesting.zip 15.6 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/12. Spark Scala Unit Testing using ScalaTest/5.1 SparkTransformerSpec.zip 703 B
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/12. Spark Scala Unit Testing using ScalaTest/6.1 SparkTransformerSpec.zip 770 B
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/12. Spark Scala Unit Testing using ScalaTest/7.1 common.zip 1.7 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/12. Spark Scala Unit Testing using ScalaTest/8.1 failtests.txt 100 B
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/12. Spark Scala Unit Testing using ScalaTest/9.1 SparkTransformerSpec.zip 811 B
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/13. Running Spark and Hive on a Cloudera QuickStart VM on GCP/1.1 pom.zip 989 B
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/13. Running Spark and Hive on a Cloudera QuickStart VM on GCP/2.1 cloudera-gcp.txt 3.4 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/13. Running Spark and Hive on a Cloudera QuickStart VM on GCP/3.1 spark2-cloudera.txt 1.5 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/13. Running Spark and Hive on a Cloudera QuickStart VM on GCP/4.1 spark-submit.txt 222 B
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/13. Running Spark and Hive on a Cloudera QuickStart VM on GCP/4.2 FutureXSparkScalaProject-spark-submit.zip 26.5 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/2.1 files.zip 509 B
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/2.2 FuturexMiscSparkScala.zip 18.7 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/4.1 files (1).zip 509 B
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/4.2 FuturexMiscSparkScala (1).zip 18.7 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/5.1 StructuredStreamingWindowAggregation.zip 823 B
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/5.2 sale.zip 530 B
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/6.1 FuturexMiscSparkScala_Filter.zip 33.7 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/7.1 StructuredStreamingDemoTimestamp.zip 721 B
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/8.1 StructuredStreamingWindowAggregation.zip 823 B
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/9.1 FuturexMiscSparkScala.zip 7.8 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/15. Creating a PySpark real world coding framework/1. PySpark Hadoop Hive development environment using PyCharm and Winutils.mp4 97.5 MB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/15. Creating a PySpark real world coding framework/1.1 hello_world_python_spark_hadoop.zip 746 B
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/15. Creating a PySpark real world coding framework/2.1 DataPipeline_v1.zip 951 B
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/15. Creating a PySpark real world coding framework/4.1 DataPipeline_v2.zip 1.2 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/15. Creating a PySpark real world coding framework/5.1 DataPipeline_v3.zip 1.5 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/15. Creating a PySpark real world coding framework/6.1 DataPipeline_v4.zip 1.7 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/16. PySpark Logging and Error Handling/2.1 DataPipeline_logging_1.zip 2.6 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/16. PySpark Logging and Error Handling/3.1 DataPipeline_Logger2.zip 2.8 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/17. Creating a Data Pipeline with Hadoop PySpark and PostgreSQL/1.1 DataPipeline_v5.zip 1.5 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/17. Creating a Data Pipeline with Hadoop PySpark and PostgreSQL/3.1 Postgres-course-catalog.zip 579 B
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/17. Creating a Data Pipeline with Hadoop PySpark and PostgreSQL/4.1 DataPipeline_psycopg2.zip 2.4 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/17. Creating a Data Pipeline with Hadoop PySpark and PostgreSQL/5.1 DataPipeline_postgres_jdbc.zip 911.8 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/17. Creating a Data Pipeline with Hadoop PySpark and PostgreSQL/6.1 pg_course.zip 315 B
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/17. Creating a Data Pipeline with Hadoop PySpark and PostgreSQL/6.2 persist_transformed_df.zip 867 B
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/18. PySpark - Reading Configuration from properties file/2.1 DataPipeline_read_config.zip 918 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/19. Unit testing PySpark application and spark-submit/1.1 test.zip 455 B
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/19. Unit testing PySpark application and spark-submit/3.1 test_transformer.zip 826 B
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/3. Hadoop - Hands-On/1. Creating a free Hadoop and Spark cluster using Google Dataproc.mp4 79.2 MB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/3. Hadoop - Hands-On/2. Storing data in HDFS and querying with Hive.mp4 82.1 MB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/3. Hadoop - Hands-On/2.1 retailstore.csv 306 B
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/3. Hadoop - Hands-On/2.2 hive-hdfs-commands.txt 1.5 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/2.1 Spark_Installation_on_Colab.zip 11.9 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/2.2 spark_installation_on_colab.py 1.3 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/3.1 python_basics.py 4.4 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/3.2 python_basics.py 4.4 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/4. PySpark RDD.mp4 78.5 MB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/4.1 pyspark_rdd.zip 15.7 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/4.2 retailstore.csv 279 B
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/5.1 pyspark_dataframe.py 4.5 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/5.2 PySpark_DataFrame.zip 17.7 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/6.1 spark-hadoop-commands.txt 1.8 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/5. Project - Bank prospects marketing data cleansing using Spark/1. Project - Bank prospects marketing data transformation using Hadoop and Spark.mp4 87.8 MB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/5. Project - Bank prospects marketing data cleansing using Spark/1.1 pyspark_bank_marketing_project.py 2.7 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/5. Project - Bank prospects marketing data cleansing using Spark/1.2 pyspark_bank_marketing_project.zip 14.7 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/5. Project - Bank prospects marketing data cleansing using Spark/2. Rapid Revision - Big Data, Hadoop and Spark concepts.mp4 108.7 MB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/6. Running the project in Scala/1.1 scala-basics.txt 1.9 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/6. Running the project in Scala/2.1 spark-scala-dataframe.txt 2.5 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/6. Running the project in Scala/3.1 spark-scala-bank-marketing-project.txt 1.3 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/7. Bank prospects data transformation using AWS S3, Glue and Athena/2.1 Creating a Data Lake using S3, Glue, Athena.zip 1.4 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/7. Bank prospects data transformation using AWS S3, Glue and Athena/6.1 Triggering AWS Glue job with a serverless Lambda function.zip 526 B
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/7. Bank prospects data transformation using AWS S3, Glue and Athena/7.1 glue_pyspark_bank_marketing_project.zip 1.2 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/8. Advanced Hive/1. Fast queries with Hive Partitioning.mp4 116.7 MB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/8. Advanced Hive/1.1 hive-partition.txt 2.3 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/8. Advanced Hive/2.1 hive-bucketing.txt 1.2 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/9. Advanced Spark/1.1 advanced_spark_datasets.zip 736.2 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/9. Advanced Spark/2.1 pyspark_udf_and_join.py 3.7 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/9. Advanced Spark/2.2 PySpark_udf_and_join.zip 16 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/9. Advanced Spark/3.1 PySpark_udf_and_join.zip 16 KB
  • [TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/9. Advanced Spark/3.2 pyspark_udf_and_join.py 3.7 KB

Rating
Not rated yet
Log in to rate

Comments

No comments yet.


Similar torrents
NameSizeDate
1.9 GB08