DATA ACCURACY & QUALITY INTELLIGENCE

Every cell in your data, probed and proven.

DataMisbar analyzes, cleans, and validates large-scale CSV datasets directly in your browser.

19
Auto-detected data types
23
Validation rule classes
10
Quality dimensions scored
customers_riyadh.csv VALIDATING
national_idNational ID mobileMobile cityText · Arabic joinedTimestamp status
Normalizing Arabic digits… DQ Index 78%
System Architecture البنية

Seven engines. One workspace.

A secure Flask backend paired with a fully responsive, framework-free JavaScript frontend delivers a desktop-grade data-preparation experience directly in the browser.

Backend Server

Flask application handling routing, session security, permission enforcement, and the CSV upload endpoint.

Data Parsing Layer

Delimiter sniffing, 19-class type inference, and index-mapped row formatting for compact network payloads.

Cleaning Engine

Whitespace, casing, fill/blank, fuzzy clustering, sandboxed expression transforms, and Unicode/Arabic/date/number/currency normalization.

Schema Engine

Split, join, derive, rename, remove, and move column operations — with facets and rules cleaned up automatically.

Facet Engine

Numeric bins, box-plot statistics, scatterplot coordinates, duplicate detection, and text filtering — computed server-side.

Database Layer

Parameterized queries with automatic MySQL-to-SQLite fallback and schema self-upgrade on startup.

Frontend Controller

A 5,500+ line asynchronous single-page state machine covering the grid, facets, validation, statistics, DQ scoring, history, and administration UI.

Intelligent Ingestion الاستيعاب الذكي

19-class automatic type inference

Uploads are sniffed for delimiter, stripped of blank rows, and converted to a compact index-mapped structure. Then every column's first 100 non-empty values run through a cascade of pattern detectors.

70% confidence threshold — if any single type reaches 70% across the sample, the column is classified and pre-seeded with a sensible default rule set. Every upload is logged to the database and a local audit CSV.
JSONParses as valid JSON
UUIDCanonical 8-4-4-4-12 hex pattern
IP AddressIPv4 / IPv6 syntax
MAC Address6-octet hex pattern
Emaillocal@domain syntax
URLhttp(s)/www or domain syntax
National ID10 digits starting with '1'
Resident / Iqama ID10 digits starting with '2'
Mobile Number05xxxxxxxx / +9665xxxxxxxx
PhoneGeneral international phone pattern
Postal Code5 digits
Booleantrue/false, yes/no, y/n, 1/0, t/f
Timestamp / DateOne of 13 recognized date(-time) formats
CurrencyNumeric with a currency symbol or code
LatitudeValid geographic range + column-name hint
LongitudeValid geographic range + column-name hint
NumberParses cleanly as a float
Text (default)Fallback below 70% confidence
Manual OverrideReclassify any column from its context menu
International formats Regional (KSA) detectors
Quality Scoring مؤشر الجودة

The 10-dimension Data Quality Index

A defensible, quantified quality score — the equal-weighted average of ten dimensions, rendered as color-coded progress bars and exportable as CSV or a formatted PDF scorecard.

Completeness(Total − Missing) / Total × 100
Accuracy(Non-missing − Errors) / Non-missing × 100
Validity(Non-missing − Errors − Warnings) / Non-missing × 100
TimelinessShare of date values not in the future
ConsistencyAvg of casing + whitespace consistency
UniquenessDistinct non-missing / total non-missing × 100
Integrity(Total − Invalid) / Total × 100
PrecisionConsistency of decimal places or value length
Reliability25% Compl. + 25% Acc. + 20% Val. + 15% Cons. + 15% Integ.
Traceability100 if key/ID field, 85 if another key exists, else 50
Subscription الاشتراك

Three tiers, one platform.

Datamisbar is available on Free, Plus, and Pro subscription tiers. Free is the default tier for every new account — email us for full plan details and to upgrade.

Default

DataMisbar Free

0 SAR / month
  • Get started at no costThe default tier for every new DataMisbar account.
  • 5 files limitUpload and validate up to 5 CSV files.

DataMisbar Plus

30 SAR / month
  • More capacity & featuresFor teams that have outgrown the Free tier.
  • 50 files limitUpload and validate up to 50 CSV files with premium cleaning.

DataMisbar Pro

65 SAR / 2 months
  • Full-featured accessFor teams with the most demanding data workflows.
  • 80 files limitUpload up to 80 CSV files, Wind Rose charts, & reports.

Also need a company-wide subscription for your organization?

Request Enterprise Quote