Browsing Tag
pyspark
3 posts
Databricks Audit Toolkit: Scheduling Automated Audits
Scheduling Automated Audits This guide explains how to run the Databricks Audit Toolkit on a schedule using common…
From Silent None to Insight: Debugging PySpark UDFs on AWS Glue with Decorators
Last month I was debugging a PySpark UDF that was silently returning None for about 2% of rows…
Feature Engineering para Embeddings com SparkML e MLFlow no Databricks Experiments
Hoje resolvi relembrar alguns conceitos de machine learning e entre eles a parte de vetorização de categorias para…