spark-sql

Collection of Databricks and Jupyter Notebooks

My notebook on using Python with Jupyter Notebook, PySpark etc

Implementation of Spark code in Jupyter notebook. Topics include: RDDs and DataFrame, exploratory data analysis (EDA), handling multiple DataFrames, visualization, Machine Learning

Big Data essentials: Hadoop, MapReduce, Spark. Explore tutorials and demos in Jupyter notebooks—most are self-contained and live, ready to run with a click.

This repo contains my learnings and practice notebooks on Spark using PySpark (Python Language API on Spark). All the notebooks in the repo can be used as template code for most of the ML algorithms and can be built upon it for more complex problems.

PySpark & Jupyter Notebooks Deployed On Kubernetes

Jupyter notebook server prepared for running Spark with Scala kernels on a remote Spark master

Sample PySpark Notebook for User Profile Analysis using PySpark SQL (to demonstrate Anti Join)

Repositório contendo todo o projeto de engenharia de dados realizado na Databricks conectando com o redshift na aws

A local open lakehouse workspace for catalog exploration, Spark SQL, notebooks, dashboards, jobs, alerts, lineage, and compute.

Spark and Spark ML notebooks

Spark Python Programs on Jupyter notebook

Jupiter notebooks for my spark tutorials.

Exercise files and notebooks for learning Apache Spark DataFrames and SQL

Explains the implementation of spark concepts using pyspark API from jupyter notebook

This notebook contains detailed code for spark and machine learning and databricks

Learning lab with PySpark notebooks covering Spark fundamentals, transformations, RDDs, Spark SQL, and practical exercises.

This repository contains Jupyter Notebooks related to fraud detection, data streaming, and real-time data visualization. These notebooks cover various aspects of processing, analyzing, and modeling data to address fraudulent transactions in eCommerce and other contexts.