lsm/seaweedfs
1
0
Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2025-09-22 20:23:39 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
11,976 Commits 48 Branches 313 Tags
93867ca04b27cb24c1e666e658ddfbf100ac8712
Commit Graph

5 Commits

Author SHA1 Message Date
chrislu
699e2f4413 feat: Add logical type support to SQL query engine 
Extended SQL engine to handle new Parquet logical types:
- Added TimestampValue comparison support (microsecond precision)
- Added DateValue comparison support (days since epoch)
- Added DecimalValue comparison support with string conversion
- Added TimeValue comparison support (microseconds since midnight)
- Enhanced valuesEqual(), valueLessThan(), valueGreaterThan() functions
- Added decimalToString() helper for precise decimal-to-string conversion
- Imported math/big for arbitrary precision decimal handling

The SQL engine can now:
- ✅ Compare TIMESTAMP values for filtering (e.g., WHERE timestamp > 1672531200000000000)
- ✅ Compare DATE values for date-based queries (e.g., WHERE birth_date >= 12345)
- ✅ Compare DECIMAL values for precise financial calculations
- ✅ Compare TIME values for time-of-day filtering

Next: Add YEAR(), MONTH(), DAY() extraction functions for date analytics.
 2025-09-03 07:29:03 -07:00
chrislu
3570027656 feat: Enable publishers to use Parquet logical types 
Enhanced MQ publishers to utilize the new logical types:
- Updated convertToRecordValue() to use TimestampValue instead of string RFC3339
- Added DateValue support for birth_date field (days since epoch)
- Added DecimalValue support for precise_amount field with configurable precision/scale
- Enhanced UserEvent struct with PreciseAmount and BirthDate fields
- Added convertToDecimal() helper using big.Rat for precise decimal conversion
- Updated test data generator to produce varied birth dates (1970-2005) and precise amounts

Publishers now generate structured data with proper logical types:
- ✅ TIMESTAMP: Microsecond precision UTC timestamps
- ✅ DATE: Birth dates as days since Unix epoch
- ✅ DECIMAL: Precise amounts with 18-digit precision, 4-decimal scale

Successfully tested with PostgreSQL integration - all topics created with logical type data.
 2025-09-03 07:26:36 -07:00
chrislu
900bd94456 address some comments 2025-09-02 16:54:34 -07:00
chrislu
586a795b02 return fast on error 2025-09-02 14:09:38 -07:00
chrislu
c9e093194d setup integration test for postgres 2025-09-02 10:51:37 -07:00