representation
Numbers, booleans, encodings, and scientific notation
8 categories, 32 types: 15 a sibling in its category also accepts, 30 accepted by another category's rule, 16 that decompose into parts, 8 in Meridian's open data.
The 8 representation categories
Each category's lookup value, against every other category's rule
| Category | Types | Casts to | For example | Within the group | Also accepted by |
|---|---|---|---|---|---|
| 7 | VARCHAR | ATGCAGC | 6 a sibling also accepts | file, text | |
| 6 | DOUBLE, BIGINT | 42 | 3 a sibling accepts, 1 misread | file, identifier, scientific, text | |
| 4 | VARCHAR, BIGINT | 1024 | 3 a sibling accepts, 1 misread | identifier, numeric, scientific, text | |
| 4 | VARCHAR, BIGINT, UUID | 1 | 3 a sibling also accepts | file, format, numeric, scientific, text | |
| 4 | VARCHAR | 😀 | each told apart | file, scientific | |
| 3 | BOOLEAN | 0 | each told apart | file, identifier, numeric, scientific, text | |
| 3 | VARCHAR | #FF0000 | each told apart | file, scientific | |
| 1 | VARCHAR | high | — | file, scientific, text |
Where representation categories overlap
Each type's lookup value, against every other category's rule
Which representation type is it?
12 of 32 representation types in 6 categories accept it, and read it 2 ways.
Binary Boolean (0/1), Boolean Initials (T/F, Y/N), Boolean Terms (True/False, Yes/No), Ordinal Value, Measurement Unit, Entity Name and Plain Text carry no pattern or format, so they have no rule to ask.
| Type | Category | Reads it as |
|---|---|---|
Numeric Code numeric_code | identifier | 840 |
Excel Number Format String excel_format | file | 840 |
File Extension extension | file | 840 |
File Size file_size | file | 840.0 |
Color (Hexadecimal) color_hex | format | 840 |
Increment / Counter increment | identifier | 840 |
Decimal Number decimal_number | numeric | 840.0 |
Decimal Number (Comma Separator) decimal_number_comma | numeric | 840.0 |
Integer Number integer_number | numeric | 840 |
Percentage percentage | numeric | 840.0 |
SMILES Notation smiles | scientific | 840 |
Single Word word | text | 840 |
What the engine extracts
- scientific5 of 7check_digit · formula · gc_content · length · molecular_weight_estimate · part1 · part2 · version
- numeric4 of 6exponent · fractional_part · has_symbol · integer_part · mantissa · percent_value
- file3 of 4category · charset · size · subtype · type · unit
- identifier1 of 4alpha_part · numeric_part
- text1 of 4char_count · word_count
- format2 of 3blue · green · hue · lightness · red · saturation
In Meridian's open data
- edgar
.ciknumeric_code.company_nameentity_name.exchangeword - edgar_gleif
.categoryword.company_nameentity_name.confidencedecimal_number.keyinteger_number.key_typeword.legal_nameentity_name.methodword.reg_statusword.tierword - gleif
.entity_statusterms.legal_formalphanumeric_id.legal_nameentity_name.registration_statusword - naics
.descriptionplain_text.levelword.titleplain_text
Use it
One value from each category, each inferred on its own
CLI · DuckDB
$ for v in 'ATGCAGC' '42' '1024' '1' '😀' '0' '#FF0000' 'high'; do finetype infer -i "$v"; done
SELECT v, ft_infer(v) FROM (VALUES ('ATGCAGC'), ('42'), ('1024'), ('1'), ('😀'), ('0'), ('#FF0000'), ('high')) t(v);