xbe.at

Topics

Data engineering

SQL, Spark, Kafka, pipelines and the plumbing under every model.

Page 2 of 2

  1. SQL vs. Pandas Mastering Data Analysis Tools9 min

    Data analysis often begins with loading datasets and performing initial inspections. Let's explore how SQL and Pandas handle this fundamental task...

  2. SQL's Execution Flow7 min

    SQL's logical processing order differs from its written syntax. Understanding this sequence is crucial for query optimization and debugging. We'll implement...

  3. The Evolution of Databases From File Systems to Modern Marvels16 min

    Understanding how to establish secure and efficient database connections is fundamental in Python. This code demonstrates connecting to different database...

  4. Time-Series Analysis with PySpark Window Functions6 min

    Window functions are powerful tools for performing calculations across a set of rows that are related to the current row. In time-series analysis, they allow...

  5. Transitioning from SQL to Pandas DataFrames Using Python4 min

    Pandas DataFrames are powerful data structures in Python that offer SQL-like functionality with added flexibility. They allow for efficient data manipulation...

  6. Understanding Apache Kafka with Python7 min

    Apache Kafka is a distributed streaming platform that allows for high-throughput, fault-tolerant, and scalable data streaming. It's designed to handle...

  7. Understanding SQL's Execution Order4 min

    SQL operates on a principle of describing what you want, rather than spelling out each computational step. This design philosophy makes SQL unique among...

  8. User Defined Functions in Apache Spark with Python8 min

    User Defined Functions (UDFs) in Apache Spark allow developers to extend Spark's built-in functionality by creating custom operations on DataFrames and...

  9. Vector Embeddings, Databases, and Search in Python7 min

    Vector embeddings are numerical representations of data in a high-dimensional space. They capture semantic relationships between objects, making them crucial...

  10. Window Functions in Apache Spark7 min

    Window functions in Apache Spark allow you to perform calculations across a set of rows that are related to the current row. These functions operate on a...