Transformations
select, filter, withColumn and groupBy build a plan.
What you will be able to do
- Chain transformations.
- Avoid collecting large data.
- Use built-in functions.
In plain English
select, filter, withColumn and groupBy build a plan.
- Chain transformations.
- Avoid collecting large data.
- Use built-in functions.
from pyspark.sql import functions as F
df.filter(F.col('minutes') >= 15).groupBy('course').count().show()Your turn
EasyExplain it back
Answer from memory: Which action returns rows to the driver?
TEXT · starter
Your answer…Check your understanding before moving on.
Knowledge checkQuestion 1
Which action returns rows to the driver?
Select an answer to continue
Study tools
Make it yours.
Keep a private note for this lesson, then turn the key ideas into flashcards you can revisit.
Sign in to save notes and flashcards.Both are private to your account and stay with your progress.
Sign inFinished reading?
Lock in what you just learned.
0%
Mark this lesson complete to save your place and move one step closer to the certificate.