Skip to content
/ dataframe-examples Public
forked from SidharthaRay/dataframe-examples

Apache Spark with Scala and AWS - DataFrame Examples

0 stars 35 forks Branches Tags Activity
Star
Notifications You must be signed in to change notification settings

hmahajansm/dataframe-examples

BranchesTags
 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

13 Commits
project
project
 
 
src/main
src/main
 
 
.gitignore
.gitignore
 
 
README.md
README.md
 
 
ab.txt
ab.txt
 
 
build.sbt
build.sbt
 
 

Repository files navigation

Dataframe Examples

  1. Challenges with RDD
  2. RDD to DataFrame conversion
  3. Data ingestion from
    1. RDBMS (MySQL)
    2. NoSQL (MongoDB)
    3. SFTP
    4. Amazon S3 bucket
    5. Amazon Redshift Database
  4. Applying transformation using
    1. DSL (Domain Spaecific Language)
    2. Spark SQL
  5. Window/analytics function (lead(), lag(), rank(), dense_rank(), etc.)

About

Apache Spark with Scala and AWS - DataFrame Examples

Resources

Readme
Activity

Stars

0 stars

Watchers

0 watching

Forks

0 forks
Report repository

Releases

No releases published

Packages

No packages published

Languages

  • Scala 100.0%