Blog
Technical exploration and thoughts · 655 articles
Offline Data Warehouse ADS Layer and Airflow Task Schedul...
Apache Airflow is an open-source task scheduling and workflow management platform, primarily used for developing, debugging, and monitoring data pipelines.
Apache Airflow Installation and Deployment for Offline Da...
Apache Airflow is an open-source task scheduling and workflow management tool for orchestrating complex data processing tasks. Originally developed by Airbnb...
Flink Broadcast State: BroadcastState Practice & Rule Upd...
Flink Broadcast State explanation: BroadcastState principle, dynamic rule updates, state partitioning and memory management, demonstrating broadcast stream and non-broadcast stream join through cases.
Flink State Backend: State Storage & Performance Optimiza...
Flink State Backend detailed explanation: HashMapStateBackend, EmbeddedRocksDBStateBackend selection, memory configuration and performance tuning.
Implementing Simple IoC-02: Implementing Business Without...
Manually implement business logic layering without using Spring, including DAO layer, Service layer, and Controller layer, demonstrating dependency management issues in traditional development.
Implementing Simple IoC-01: Servlet Introduction and Basi...
Step-by-step guide to implementing a simple Spring IoC container, Part 1 covering Servlet basics, characteristics, working principles, and writing your first Servlet program.
Offline Data Warehouse - Hive Order Zipper Table: Increme...
This article continues the zipper table practice, focusing on order history state incremental refresh. It explains how to use ODS daily incremental table + DWD zipper table to preserve order histor...
Offline Data Warehouse Dimension Tables: Product Category...
First determines fact tables vs dimension tables: green indicates fact tables, gray indicates dimension tables. Dimension table processing strategies vary by...
Offline Data Warehouse DWD and DWS Layer: Table Creation ...
The order table is a periodic fact table; zipper tables can be used to retain order status history. Order detail tables are regular fact tables. Order statuses...
FastDFS Architecture: Storage/Tracker/Group Design
FastDFS core architecture deep dive: Tracker Server, Storage Server, Group mechanism. This article analyzes principles and practices to help readers master key technical points.
Spring Overview: History and Core Concepts IoC, AOP
Comprehensive introduction to Spring framework basics, evolution from EJB to Spring, detailed explanation of Spring's core concepts including IoC and AOP with practical implementation analysis.
Offline Data Warehouse - Hive Zipper Table Practice: Orde...
This article provides a practical guide to Hive zipper tables for preserving order history states at low cost in offline data warehouses, supporting daily backtracking and change analysis. It cover...
Handwritten ORM Framework 4: Framework Optimization and D...
Optimize handwritten ORM framework, focusing on getMapper method implementation in DefaultSqlSession, using JDK dynamic proxy to create Mapper interface proxy objects. Practical analysis of princip...
Offline Data Warehouse - Hive Zipper Table Practice: Init...
This article provides a practical guide to Hive zipper table implementation for offline data warehouse modeling, covering initial loading, daily incremental updates, historical version chain closin...
FastDFS 6.15.0+Nginx Dynamic Module: Source Compile to Ac...
Complete guide for FastDFS 6.15.0 source compilation and Nginx fastdfs-nginx-module configuration. This article analyzes principles and practices to help readers master key technical points.
Handwritten ORM Framework 3: SqlSession, Executor Working...
In-depth analysis of SqlSession and Executor working principles in handwritten ORM framework, detailing implementation mechanisms of SqlSessionFactoryBuilder, DefaultSqlSession, SimpleExecutor.
Offline Data Warehouse - Hive Zipper Table Getting Starte...
This article systematically covers Slowly Changing Dimensions (SCD), detailing the core differences between SCD Type 0, 1, 2, 3, 4, and 6, and explains the applicable boundaries of snapshot tables ...
Handwritten ORM Framework 2: Resources, MappedStatement, ...
This article teaches you to handwrite an ORM framework, detailing the implementation of core components like Resources, MappedStatement, XMLBuilder, including configuration file parsing and mapping...
FastDFS: From Standalone to Distributed File Storage
FastDFS distributed file system architecture, evolution from standalone to distributed. This article analyzes principles and practices to help readers master key technical points and practical skills.
Handwritten ORM Framework 1 - JDBC Problems and Solutions
First article in the handwritten ORM framework series, introducing problems and disadvantages of traditional JDBC development and ORM framework design ideas and solutions. Practical analysis of pri...