% -->

Scripting with Python and SQL for Data Engineering

Master data engineering fundamentals through hands-on experience with Python and SQL. This comprehensive course covers essential topics including data structures, web scraping, database management with SQLite and MySQL, and efficient data processing techniques. Students will learn to write production-ready scripts, work with various data formats, and build automated data pipelines while implementing industry best practices for data engineering workflows.

Learn More

Trusted by 1M+ Learners

Our university-grade curriculum has helped professionals worldwide transform their careers in AI, Data Science, Cloud Computing, and programming..

Same curriculum taught at Duke, Northwestern, and UC Davis

Practical, hands-on projects that mirror real-world challenges

Industry-recognized certification upon completion

4 weeks, 100 lessons total which includes hands-on labs, quizzes, and a certification.

Join today Go to course

Learn from top university instructors

The curated content for the bootcamp is based on the same material we use at top universities like Duke University, Northwestern, and UC Davis.

Practical and hands on

The material and content goes beyond the basic theory and is meant for you to practice, enhancing your learning.

Get access to high-quality, curated content

All exercises, readings, examples, and video content is of extremely high quality and you will get access to all of it in this bootcamp.

Join half a million learners

We've specialized in teaching based on our vast experience in tech. Be part of half a million learners who have used our courses!

Syllabus

This course is packed with useful content, curated from our experience working with top-tier universities and learners all around the world. Get certified at the end of this course with a shareable digital badge.

Week 1

  • Welcome to scripting with python and SQL for data engineering
  • Connect with your instructor
  • Meet your supporting instructors kennedy Behrman and NOAH gift
  • Key terms
  • Using lists to save and retrieve data in python
  • Key terms
  • Iterating over lists and dictionaries in python
  • Iterating over other data structures in python
  • Key terms
  • Loading data from files and file paths in python
  • Working with JSON in python
  • Build a notebook that Reformats data into JSON

Week 2

  • Key terms
  • Creating a script as a module in python
  • Key terms
  • What is Sqlite
  • Key terms
  • Basic SQL commands in python
  • Extracting distinct data using SQL in python
  • Create a reporting script for file sizes

Week 3

  • Key terms
  • Challenges with web data
  • Key terms
  • Creating a web Scraping project with Scrapy in python
  • Parsing data with Xpath and Scrapy shell
  • Key terms
  • Scraping locally
  • Persisting data in CSV and JSON formats
  • Build a web Scraping tool

Week 4

  • Key terms
  • Connecting to a mysql server
  • Key terms
  • Using Vscode to execute mysql queries
  • Working with Vscode and mysql
  • Key terms
  • Importing CSV data into mysql
  • Exporting data from mysql
  • Loading and Exporting data using mysql

Custom training for your company

We are ready to deliver this and other training to your group. We can usually accommodate different requirements and are flexible with the number of seats. Reach out to us at contact@paiml.com

  • Bulk pricing available
  • Customizable content
  • Ready to start on your schedule