unit-4.md

Unit 4: Datastores, and Processing CSV Data

Prerequisites: Python Language Overview

Learning Objectives

In this unit, we'll illustrate the concept of program-data independence as we explore integrations between software and datastores. We'll focus on the Comma-separated Values (CSV) data format and learn how to use Python to process CSV data.

Slides

Discussions and Notes

• Program-Data Independence
• Datastores, Databases, and CSV Files

Reference Documents

• Managing Files:
  • The os Module (w/ focus on file and directory operations)
• Processing Data:
  • The itertools Module
• Managing Packages w/ the pip Utility
• Processing CSV Files:
  • The csv Module
  • The pandas Package
• Processing Data in other Formats (just for your awareness):
  • The json Module (for processing JSON)
  • The BeautifulSoup Package (for processing XML and HTML)
  • The pdftotext Utility (for parsing PDFs)
  • The fpdf Package (for generating PDFs)
  • The psycopg Package (for PostgreSQL databases)
  • The pymysql Package (for MySQL databases)

Activities and Exercises

• "Omniparser" Exercise
• "Monthly Sales Reporting" Exercise