Gleam Lab · Blog Archive
Blog Page 18
Technical exploration and engineering notes, 655 articles in total.
Flume 1.9.0 Custom Interceptor: TAILDIR Multi-directory Collection, Filter by Logtime
Using TAILDIR Source to monitor multiple directories (start/event), using filegroups headers to mark different sources with logtype
MyBatis Quick Start - CRUD Operations and XML Mapping Configuration
MyBatis quick start continuation covering CRUD operations, XML mapping configuration, annotation-based development, and datasource/transaction management.
Neo4j Installation and Quick Start | 10 Min Setup + Remote Access
Neo4j graph database Docker installation and remote access configuration, 10-minute quick start guide.
MyBatis SqlSession, Executor, StatementHandler - Source Code Analysis
2k, likes: 27, favorites: 13. Configuration comes from two sources: configuration files (main config.xml, mapper.xml) and Java code annotations.
MyBatis Plugin Mechanism - PageHelper and Generic Mapper
Detailed introduction to MyBatis pagination plugin PageHelper and Generic Mapper usage, including configuration, code examples, PageInfo class usage, and Generic Mapper C...
Big Data 226 - Flume Optimization for Offline Data Warehouse: batchSize, Channels, Compression, Interceptors & OOM Tuning
Flume 1.9.0 tuning guide for offline data warehouse log collection to HDFS, covering batch parameters, channel capacity and transaction sizing, JVM heap tuning...
Big Data 87 - Spark DStream Transformation Operators: map, reduceByKey and transform
Systematically review Spark Streaming DStream stateless transformation operators and transform advanced operations, demonstrating three implementation approaches for blac...
Spark Streaming Window Operations & State Tracking: updateStateByKey & mapWithState
In-depth explanation of Spark Streaming stateful computing: window operation parameter configuration, reduceByKeyAndWindow hot word statistics, updateStateByKey full-stat...
MyBatis Quick Start - POM, Mapper, Core Files, CRUD Operations and Annotation Mapping
MyBatis quick start tutorial covering MyBatis development steps including POM dependency configuration, Mapper mapping files, SqlMapConfig core configuration file...
Offline Data Warehouse Member Metrics Practice
Scenario: Use startup logs/event logs in offline data warehouse to count new, active (DAU/WAU/MAU), retention.
MyBatis Deep Dive - ORM Concepts, Mapping Relations and Quick Start
ORM stands for Object/Relation Mapping: an abbreviation for object-relation mapping.
MySQL Master-Slave Replication: Read-Write Separation and Semi-Sync Replication
This article provides an in-depth explanation of MySQL master-slave replication: master-slave mode, read-write separation, semi-sync replication principles and configurat...
MySQL Design Guide: Availability, Scalability, Consistency
This article provides an in-depth explanation of MySQL database design: availability (redundancy, failover), scalability (sharding, read-write separation), consistency.
MySQL Deadlock: Principles, Scenarios and Prevention
This article provides an in-depth explanation of MySQL deadlocks: deadlock definition, necessary conditions, table lock deadlocks, row-level deadlocks, shared to exclusiv...
MySQL Lock Mechanism: From Table Locks to Row Locks
Pessimistic locking is a concurrency control mechanism based on a conservative "lock first, then modify" strategy.
MySQL Parallel Replication: From 5.6 to 8.0 Evolution
This article provides an in-depth explanation of MySQL parallel replication technology: from 5.6 database-based parallel to 5.7 group commit-based to 8.
MySQL Dual-Master Architecture and MMM High Availability
MySQL dual-master mode is a common high-availability database architecture solution, particularly suitable for the following business scenarios:
MySQL MHA Master-Slave Failover: Architecture and Implementation
Deep dive into MySQL MHA high availability solution: MHA architecture, fault handling, primary-standby switch, lag issues and solutions. This article analyzes principles...
MySQL Sharding Technologies Compared: Range, Hash, Consistent Hash and Geohash
Sharding is the core technology for horizontal scaling in distributed databases.
MySQL Distributed Primary Key Strategies: UUID, SnowFlake, Redis and ID Tables
Explore MySQL distributed primary key strategies including UUID, SnowFlake, COMB, Redis, and database ID table approaches with their principles, pros and cons...