Spark Scala Coding Framework , Best Practices & Unit Testing

Spark Scala Coding Framework , Best Practices & Unit Testing, Spark Scala Framework, Hive, IntelliJ, Maven, Winutil, Postgres,Logging, Exception Handling, log4j, ScalaTest JUnit Test

• NEW
• Created by FutureX Skill
• English

PREVIEW THIS COURSE - GET COUPON CODE

Description

This course will bridge the gap between your academic and real world knowledge and prepare you for an entry level Big Data Spark Scala developer role. You will learn the following

Spark Scala coding best practices

Logging - log4j, slf4

Exception Handling

Configuration using Typesafe config

Doing development work using IntelliJ, Maven

Using your local environment as a Hadoop Hive environment

Reading and writing to a Postgres database using Spark

Unit Testing Spark Scala using JUnit , ScalaTest, FlatSpec & Assertion

Building a data pipeline using Hadoop , Spark and Postgres

Bonus - Setting up Cloudera QuickStart VM on Google Cloud Platform (GCP)

Prerequisites :

Basic programming skills

Basic database knowledge

Big Data and Spark entry level knowledge

More Courses by FutureX Skill

A Big Data Hadoop and Spark project for absolute beginners

Hadoop, Spark, Python, Scala, Dataproc, AWS S3 Data Lake, Glue, Athena, Machine Learning, Intellij, Maven, QuickStart VM

A Java Spring Boot Microservices project for beginners

Java, Spring Framework, Spring Boot, Spring Cloud, Microservices for absolute beginners, Eclipse, IntelliJ, REST, JPA

Mathematics revision for Machine Learning, IIM CAT and GMAT
Mathematics, Statistics, Probability, Quant for Machine Learning, IIM CAT, GMAT and other competitive exams