Spark SQL
Register views and run SQL over distributed data.
What you will be able to do
- Create a temp view.
- Use spark.sql.
- Mix SQL and DataFrames.
In plain English
Register views and run SQL over distributed data.
- Create a temp view.
- Use spark.sql.
- Mix SQL and DataFrames.
df.createOrReplaceTempView('lessons')
spark.sql('SELECT course, count(*) AS n FROM lessons GROUP BY course').show()Your turn
EasyExplain it back
Answer from memory: Which method runs SQL?
TEXT · starter
Your answer…Check your understanding before moving on.
Knowledge checkQuestion 1
Which method runs SQL?
Select an answer to continue
Study tools
Make it yours.
Keep a private note for this lesson, then turn the key ideas into flashcards you can revisit.
Sign in to save notes and flashcards.Both are private to your account and stay with your progress.
Sign inFinished reading?
Lock in what you just learned.
0%
Mark this lesson complete to save your place and move one step closer to the certificate.