Data Health

What each nightly crawler run added, how the database is growing, and whether the data sample is large enough for each analytics feature.

Latest run

Finishedstarted Oct 7, 2:03 AM ET · 1h 15m
Matches enriched
+2,986
19,027 total
With telemetry
+2,958
18,777 total
Database
2,531 MB
+102 MB · 49% of 5 GB
PUBG API
3,000 calls
0 rate-limited · 0 failed · telemetry 100.0% ok

Parquet store: Population snapshots 10,851,438 · Landing events 1,492,522 · Phase circles 144,582 · Crate loot events 322,801 · Participants 1,422,727 · 2,059,048 rows moved out of Postgres this run

StepResultTimeMatches enrichedMatches with telemetryParticipantsPopulation snapshotsPlayersAPI callsPeak memory
sync-allOK0m······100 MB / 54 MB
backlogOK1h 0m+2,885+2,871+239,015+1,643,892·2,8851.7 GB / 1.7 GB
crawl:steamOK3m+92+92+8,169+57,246+2092728 MB / 713 MB
crawl:xboxOK1m+23+23+1,715+13,724+723420 MB / 414 MB
cleanseOK0m-14-28·-12··174 MB / 93 MB
archive export + verifyOK2m······1000 MB / 1.4 GB
backupOK4m······119 MB / 140 MB
compute-analyticsOK4m······1.7 GB / 2.8 GB
purgeOK1m···-1,714,850··253 MB / 1.4 GB

Growth

Database size (MB) by run
Matches with telemetry, total, by run
Matches by day played (last 14 days)
RunStatusDurationMatches enrichedWith telemetryPlayersDatabase
Oct 7, 2:03 AM ETFinished1h 15m+2,986+2,958+272,531 MB
Oct 6, 2:02 AM ETFinished1h 12m+2,979+2,925+172,429 MB
Oct 5, 2:00 AM ETFinished1h 15m+2,990+2,919+152,333 MB
Oct 4, 2:03 AM ETFinished4h 15m+1,876+1,862+2962,256 MB
Oct 3, 2:00 AM ETFinished4h 11m+1,872+1,845+3022,657 MB
Oct 2, 2:01 AM ETFinished4h 3m+1,873+1,864+3002,041 MB
Oct 1, 8:13 PM ETFinished8m+24+24+191,413 MB
Oct 1, 11:37 AM ETFinished4h 2m+929+911+1501,401 MB

Runs marked Stopped early were terminated before finishing (for example by a redeploy); their rows show what was saved up to that point.

Collector

In analyticsOn-demand runs that write matches straight to Parquet
Matches collected
11,471
54 batches
Parquet size
159 MB
14.1 KB per match
Today (ET)
0
of 10,000 daily cap
By platform
steam 7,954 · xbox 3,517
last batch Oct 6, 10:11 PM ET
RunPlatformsMatchesTimePer hourSizeLookupsProblemsStopped because
Oct 6, 6:11 PM ETsteam 2,976 · xbox 2,2335,2094h 0m1,30262 MB87921time limit (240 min)
Oct 4, 9:41 AM ETsteam 2,013 · xbox 2282,2411h 54m1,17841 MB43420every map reached its target
Oct 4, 8:16 AM ETsteam 405 · xbox 5951,0006m9,34111 MB160target reached (1000)
Oct 3, 4:01 PM ETsteam 532 · xbox 4681,0004m13,53515 MB20target reached (1000)
Oct 3, 12:37 PM ETsteam 2,0002,0007m16,56827 MB20target reached (2000)
Oct 3, 12:34 PM ETsteam 20020037s19,2542.5 MB00target reached (200)

All game modes are collected; the analytics pages use solo, duo and squad only. Matches already in the nightly crawl's data are skipped. Hover a Problems count for the breakdown.

Data sample

As of Oct 7, 3:18 AM ET (end of the last completed run). A match counts once its telemetry is ingested.

Matches with telemetry
18,777
Unique players
756,081
1,422,727 appearances
Players with ≥10 games
14,508
needed for skill baselines
Telemetry ingested
98.7%
of enriched battle-royale matches
MapIn analyticsCrawled hereLast 7 daysPC / ConsolePatchesTop modesLatest match
Erangel18,0085,0561,9542,610 / 2,44643.1 (5,051), 42.3 (5)squad (4,255), duo (377), solo (201)Oct 7
Miramar10,4762,4471,1431,133 / 1,31443.1 (2,445), 42.3 (2)squad (2,265), duo (95), ibr (39)Oct 7
Taego18,8434,8361,9163,377 / 1,45943.1 (4,833), 42.3 (3)squad (4,454), duo (260), ibr (36)Oct 7
Vikendi3,11826724237 / 3043.1 (267)squad (183), ibr (46), duo (16)Oct 6
Deston2,51816218136 / 2643.1 (162)squad (108), ibr (34), duo (11)Oct 4
Rondo8,9062,027638646 / 1,38143.1 (2,025), 42.3 (2)squad (1,891), duo (76), ibr (50)Oct 6
Sanhok10,4633,2051,5503,061 / 14443.1 (3,205)squad (2,747), duo (311), solo (93)Oct 6
Paramo3,0002453215 / 23043.1 (245)squad (165), ibr (40), duo (32)Oct 6
Karakin3,047497251267 / 23043.1 (497)squad (380), duo (63), ibr (37)Oct 6

Readiness by feature

MapDrop heatmapLocation statsDrop recommenderRotation recommenderPatch comparison
ErangelReady18,008/100Ready18,008/500Ready18,008/2,000Ready18,008/3,000Not yet5/300
MiramarReady10,476/100Ready10,476/500Ready10,476/2,000Ready10,476/3,000Not yet2/300
TaegoReady18,843/100Ready18,843/500Ready18,843/2,000Ready18,843/3,000Not yet3/300
VikendiReady3,118/100Ready3,118/500Ready3,118/2,000Ready3,118/3,000Not yet0/300
DestonReady2,518/100Ready2,518/500Ready2,518/2,000Thin2,518/3,000Not yet0/300
RondoReady8,906/100Ready8,906/500Ready8,906/2,000Ready8,906/3,000Not yet2/300
SanhokReady10,463/100Ready10,463/500Ready10,463/2,000Ready10,463/3,000Not yet0/300
ParamoReady3,000/100Ready3,000/500Ready3,000/2,000Ready3,000/3,000Not yet0/300
KarakinReady3,047/100Ready3,047/500Ready3,047/2,000Ready3,047/3,000Not yet0/300

Skill & style baselines (#36): Ready14,508 of 5,000 players with ≥10 games

Map features count the standard battle royale matches the analytics pages read (In analytics), including older imported data; patch comparison uses the crawled matches' patches. Thresholds are judgment calls for "enough data to trust per-location / per-cell numbers", not statistical tests: Drop heatmap 30 thin / 100 ready (matches); Location stats 150 thin / 500 ready (matches); Patch comparison 100 thin / 300 ready (matches in 2nd-largest patch); Drop recommender 700 thin / 2,000 ready (matches); Rotation recommender 1,000 thin / 3,000 ready (matches); Skill & style baselines 1,000 thin / 5,000 ready (players with ≥10 games).