Explorer: distributions and relationships

Analytics manual

Tags: Analytics

[download original] [view raw text] — 10,143 bytes

On this page

Explorer: distributions and relationships

Analytics manual

Explorer adds 32 measurement families across Distributions, Relationships, Sequences, Compare and Observability. Choose a subview, then select a Chart family. Some families have multiple related charts, such as a histogram and the corresponding empirical cumulative distribution. The original standard workspaces retain their established definitions; Explorer's methods are labeled separately.

How to read an Explorer chart

  1. Apply the desired shared filters first.

  2. Choose the Explorer subview and chart family.

  3. Set only the local controls relevant to that measurement.

  4. Check the available/eligible/unavailable counts and the measurement state.

  5. Open Measurement, coverage and evidence definition for the observation unit, date basis, timezone, precision, branch policy, counting perspective, source representation, reliability, algorithm and evidence rule.

  6. Read the drawing together with the complete Exact data table.

  7. Select a populated mark or table row to inspect the corresponding contributors.

The default local settings use response content, segment-length lens, provider grouping, character volume, attachment bytes, segment temporal units, count-based seasonality, conversation relationships, selected association context and a visible-mark limit of 40. Individual charts expose only supported controls. Changing a display presentation does not silently replace the underlying measurement.

The visible-mark selector normally offers 20, 40, 100 or 200; co-occurrence matrices offer 20, 40 or 100. Some compact grids and structure profiles do not use that selector. The disclosure states how much is drawn. Exact table rows remain available through 50-row paging. Table search narrows visible table rows. Copy exact table copies the complete chart-local table, not just the current page.

Distribution families 01–06

FamilyQuestion it answersControls and interpretation
01 Length histogram and ECDFHow are observed text lengths distributed?Choose user, response, original trace or summary; choose segment or supported logical-message lens. Histogram bins are lower-inclusive and upper-exclusive. ECDF shows the fraction at or below each threshold.
02 Distribution groups and box plotsHow does the length distribution differ by provider, model or observed month?Choose the content population and grouping. Read count, minimum, quartiles, median, maximum and mean. A sample with fewer than five observations is flagged as small.
03 Conversation concentrationHow much of the selected volume comes from the largest conversations?Choose characters or segments. Rank and cumulative share describe concentration; top 1%, 5% and 10% use rounded-up conversation counts, with at least one conversation when any exist.
04 Code-block size by declared languageHow large are retained fenced code bodies?Choose body characters or lines. The first word of the exact declaration supplies the language group; Unspecified is explicit. Closed and unclosed fences remain distinguishable.
05 Exact prompt-repeat spectrumHow often does identical normalized prompt wording recur?Uses complete trustworthy logical prompts, or a disclosed segment fallback. Frequency, distinct conversations and distinct models are different dimensions. It is wording equality, not request identity.
06 Attachment size and image dimensionsWhat metadata describes retained attachments?Choose bytes, dimensions or aspect ratio. A true zero-byte value is available; missing size is not zero. Dimensions need positive recorded values and do not prove image-file access.

The length histograms use fixed bins from zero through very large texts, ending with an open-ended range. A label such as [100, 250) means at least 100 and fewer than 250. The final range has no finite upper boundary. Do not read equal visual bin widths as equal numerical widths.

Explorer quartiles use the R7 definition: sort observations, locate (N−1) × p, and interpolate between neighboring observations as needed. Membership weighting behaves as integer repetitions without expanding them into a separate array. These quantiles can differ from legacy percentile definitions. A different median produced by a different population or algorithm is not automatically a bug.

An observed empty string has length zero. Missing/redacted text, incomplete grouping or a required missing full-text index makes the measurement unavailable. A truncated evidence excerpt is never used as a substitute for full captured length.

Calendar and progression families 07–12

FamilyWhat is measuredRead the boundary carefully
07 Weekday × hour heatmap168 weekday/hour cells in the chosen timezoneChoose segments, stored objects or supported logical messages. Clock-precision original timestamps are required; day-only dates cannot supply hours.
08 Calendar seasonalityMonth/year counts, within-year shares or rates per calendar dayChoose Count, Share or Rate. Rates account for actual calendar days, leap days and clipping by the selected range.
09 Observed streaks and gapsRuns of active calendar days and intervening empty daysThe first/last archive runs can be censored by the observation window. A gap is the number of empty days between activity, not calendar distance.
10 Observed conversation continuationWhether retained conversations have later observed activity at week offsetsCohorts use first retained dated messages; a later offset needs adequate follow-up coverage. This is not user retention or churn.
11 Response shape by conversation positionObserved reply-length bands and code share by retained reply ordinalA supported original selected path or verified source order is required. Filtered-out replies leave ordinal gaps; this does not measure learning or fatigue.
12 Recorded timestamp intervalsGaps between verified adjacent original observationsBoth endpoints need clock precision and must remain selected. Ties, reversed timestamps, precision gaps and filtered gaps are separate. This is not generation latency or time to first token.

For heatmaps, inspect cell counts and coverage before comparing intensities. A missing source capability is different from a valid zero-count cell. A change of timezone can move an event into another hour or day without changing the underlying event.

Relationship families 13–18

FamilyQuestion and local choicesLimits
13 Prompt volume × reply volumeCompare user and final-response character volume by conversation, or by a verified paired relationshipThe paired lens needs recorded parent ancestry or a verified shared turn; array order and a logical ID alone do not prove pairing
14 Exported trace × final responseCompare original trace or summary representation against final response, using conversation or same-object lensSummary-only observations remain separate; a missing trace is not zero hidden reasoning; ratio-of-sums differs from a distribution of per-unit ratios
15 Content-feature prevalence by modelCompare the share of supported logical final replies containing parsed featuresPresence per reply, occurrence totals and denominators differ; attachment metadata uses a separate eligible population
16 Model and code-language co-occurrenceInspect recorded presence sets by model or language, using joint count or Jaccard similarityRepeating the same block does not multiply presence; remaining labels may join an explicit Other set; co-occurrence is not causation
17 Reference channels and domain concentrationCompare textual links, structured references, unlinked markers and recorded domainsOnly HTTP(S) URLs enter domain cells; identical URLs across channels deduplicate within the scoped source object; no URL is fetched
18 Parser-derived Markdown structureInspect headings, lists/items, quotes, tables, code, links/images, breaks and paragraphsCounts come from a CommonMark/GFM parser over complete owned text; they do not overwrite legacy regex measures

The prompt/reply and trace/response density grids use equally spaced labeled bins so an outlier cannot compress the smaller ranges. Labels abbreviate 1,000 as k and 1,000,000 as M; hover and keyboard focus show exact ranges. Color strength uses a logarithmic count scale, while cell text and exact tables retain original counts. Every populated bin is shown. Empty combinations have zero observed support and no contributing evidence; unavailable observations remain a separate coverage population.

Small density grids stay compact inside their card in this release. Larger grids retain their available-width layout. The grid itself avoids a separate scroll region for these compact density views, although the workspace still scrolls in a shorter window.

Co-occurrence maps use matching labels on both axes. Mirrored cells refer to the same recorded relationship and open the same contributors; do not add both halves to claim twice as many observations. Jaccard is joint presence divided by union presence. An Other presence set is the union of omitted labels, not a single newly discovered model or language.

Markdown structure analysis has bounded parser work. An individual text input beyond the parser bounds, a parser failure or a missing current full-text index makes the affected structure observations unavailable with a reason. Other independently supported measurements can remain available.

Save an exploration

Choose Save exploration preset, enter a descriptive name up to 200 characters, and save. A preset retains shared filters, selected subview/chart, local Explorer configuration and any applied A/B comparison. Apply it later from Sources & settings. It is more specific than an ordinary saved view and is still not a backup of source data.

Continue with sequences, observability and history.