Changelog¶

All notable changes to revo-norm are documented here.

v0.2.0-dev (Current)¶

Single unified pipeline architecture with entity extraction always enabled.

Single pipeline architecture: Entity extraction is always enabled, replacing the dual-pipeline (legacy vs entity extraction) approach
profile= parameter: Preset configurations (minimal, basic, standard, aggressive) passed directly to normalize_text()
disable= parameter: Disable specific features by name instead of individual boolean flags
Config dataclass: Simple feature-toggle configuration replacing NormalizationConfig, FeatureGroup, FeatureLevel, and Profile enums
Pronunciation mappings system: Explicit mappings applied first in pipeline (GUI -> gooey, ASCII -> as key, IEEE -> I triple E)
Custom pronunciation mappings: add_custom_mapping() API for user-defined overrides
Currency entity extraction: RM, $, EUR, GBP amounts protected from downstream acronym/abbreviation expansion
Currency K/M/B/T suffix expansion: RM30K -> RM30000, RM1.5M -> RM1500000
Date recognition: 15/08/2025 -> spoken date form (DD/MM/YYYY and YYYY-MM-DD formats)
Time recognition: 3:30 pm -> spoken time form
Malay-specific features: IC numbers, hari bulan, hijri years, x-kali multipliers, elongated word normalization
Entity types: URL, email, date, time, currency, fraction, temperature, IC, hari_bulan, hijri, x_kali

Entity extraction runs automatically (no extract_entities_first flag needed)
Acronym expansion merged into replace_letter_period_sequences()
96 acronyms removed from abbreviation list to avoid conflicts with acronym expansion
Single-letter and short uppercase abbreviation expansion disabled to prevent breaking domain terms
Pre-compiled regex patterns at module level for performance

Boolean flags in normalize_text() (e.g., normalize_temperature_flag=False) -- use disable=["temperature"]
NormalizationConfig class -- use Config
FeatureGroup, FeatureLevel, Profile enums -- use plain strings
minimal_config(), basic_config(), standard_config(), aggressive_config() -- use Config.from_profile() or profile= parameter
config.with_feature() -- set attributes directly: cfg.acronyms = False
config.with_sound_words() -- set cfg.sound_words directly

Date/fraction pattern conflict (entity extraction prevents false fraction matches on dates)
RM currency split to "R M" by acronym expansion (entity extraction protects currency)
JSON/ML/AI unwanted splitting by pronunciation mappings and acronym rules
Double pronunciation override call
Hari bulan placeholder robustness (__HARI_BULAN__)
Hyphens between words replaced with spaces before acronym expansion

Initial release.