extract: 2019-00-00-liu-modeling-nonstationary-non-poisson-arrival-processes

Pentagon-Agent: Ganymede <F99EBFA6-547B-4096-BEEA-1D59C3E4028A>

domains/internet-finance/arrival-process-burstiness-increases-required-capacity-for-fixed-service-level.md

@@ -0,0 +1,38 @@
+---
+type: claim
+domain: internet-finance
+description: "Higher variance-to-mean ratio requires more capacity to maintain same congestion level"
+confidence: proven
+source: "Liu et al. (NC State), 'Modeling and Simulation of Nonstationary Non-Poisson Arrival Processes' (2019)"
+created: 2026-03-11
+---
+
+# Arrival process burstiness increases required capacity for fixed service level
+
+Congestion measures (queue length, wait time, utilization) are increasing functions of arrival process variability. For a fixed average arrival rate and service rate, a bursty arrival process requires more capacity than a smooth (Poisson) arrival process to maintain the same service level.
+
+This means that modeling arrivals as Poisson when they are actually bursty (higher variance-to-mean ratio) will systematically underestimate required capacity, leading to service degradation.
+
+## Evidence
+
+Liu et al. establish that "congestion measures are increasing functions of arrival process variability — more bursty = more capacity needed." This is a fundamental result in queueing theory: variance in the arrival process translates directly to variance in system state, which manifests as congestion.
+
+The CIATA method explicitly models the "asymptotic variance-to-mean (dispersion) ratio" as a separate parameter from the rate function, recognizing that burstiness is a first-order determinant of system performance, not a second-order correction.
+
+## Application to Research Pipeline Capacity
+
+For pipelines processing research sources that arrive in bursts:
+
+1. A Poisson model with the same average rate will underestimate queue lengths and wait times
+2. Capacity sized for Poisson arrivals will experience congestion during burst periods
+3. The dispersion ratio (variance/mean) must be measured and incorporated into capacity planning
+
+The MMPP framework provides a tractable way to model this: the state-switching structure naturally generates higher variance than Poisson while remaining analytically tractable for capacity calculations.
+
+---
+
+Relevant Notes:
+- domains/internet-finance/_map
+
+Topics:
+- core/mechanisms/_map

domains/internet-finance/constant-rate-approximation-of-time-varying-arrivals-causes-systematic-staffing-errors.md

@@ -0,0 +1,38 @@
+---
+type: claim
+domain: internet-finance
+description: "Using max or average rate instead of time-varying rate leads to chronic under or overstaffing"
+confidence: proven
+source: "Liu et al. (NC State), 'Modeling and Simulation of Nonstationary Non-Poisson Arrival Processes' (2019)"
+created: 2026-03-11
+---
+
+# Constant rate approximation of time-varying arrivals causes systematic staffing errors
+
+Replacing a time-varying arrival rate λ(t) with a constant approximation—whether the maximum rate, average rate, or any other single value—leads to systematic capacity planning failures. Systems sized for maximum rate are chronically overstaffed during low-demand periods, wasting resources. Systems sized for average rate are chronically understaffed during high-demand periods, creating congestion.
+
+This is not a minor efficiency loss but a structural mismatch: the constant-rate approximation discards the temporal structure of demand, making it impossible to match capacity to load.
+
+## Evidence
+
+Liu et al. explicitly state that "replacing a time-varying arrival rate with a constant (max or average) leads to systems being badly understaffed or overstaffed." This is a direct consequence of nonstationary arrival processes where demand varies predictably over time.
+
+The paper demonstrates that "congestion measures are increasing functions of arrival process variability," meaning that even if average load is manageable, temporal concentration of arrivals creates congestion that constant-rate models cannot predict.
+
+## Implications for Pipeline Architecture
+
+For capital formation pipelines with session-based arrival patterns, this means:
+
+1. Sizing capacity for peak (research session active) rate wastes resources during quiet periods
+2. Sizing capacity for average rate creates backlogs during research sessions
+3. Optimal capacity must be time-varying or must use queueing/buffering to smooth demand
+
+The MMPP framework provides tools to size capacity for the mixture of states rather than for a single average state, enabling more efficient resource allocation.
+
+---
+
+Relevant Notes:
+- domains/internet-finance/_map
+
+Topics:
+- core/mechanisms/_map

domains/internet-finance/mmpp-models-session-based-bursty-arrivals-through-hidden-state-markov-chain.md

@@ -0,0 +1,36 @@
+---
+type: claim
+domain: internet-finance
+description: "Hidden Markov chain governs rate switching between active and quiet states"
+confidence: proven
+source: "Liu et al. (NC State), 'Modeling and Simulation of Nonstationary Non-Poisson Arrival Processes' (2019)"
+created: 2026-03-11
+---
+
+# MMPP models session-based bursty arrivals through hidden state Markov chain
+
+Markov-Modulated Poisson Process (MMPP) provides a natural framework for modeling arrival processes that alternate between active and quiet periods. The arrival rate switches between discrete states governed by a continuous-time Markov chain, where the state transitions are hidden but the arrival rate in each state is observable.
+
+This architecture directly captures "research session" dynamics where an unobservable state (researcher actively working vs. not working) determines whether arrivals occur at high rate (burst) or low rate (quiet).
+
+## Evidence
+
+Liu et al. define MMPP as a process where "arrival rate switches between states governed by a hidden Markov chain — natural model for 'bursty then quiet' patterns." The underlying Markov chain controls state transitions, while each state has an associated Poisson arrival rate.
+
+The paper notes that "congestion measures are increasing functions of arrival process variability — more bursty = more capacity needed," establishing that MMPP's ability to model burstiness has direct operational implications for capacity planning.
+
+The Markov-MECO process, a related Markovian arrival process (MAP), models "interarrival times as absorption times of a continuous-time Markov chain," providing the theoretical foundation for state-dependent arrival modeling.
+
+## Application to Capital Formation Pipelines
+
+Research-driven capital formation exhibits textbook MMPP behavior: during active research sessions, sources arrive in bursts of 10-20; during inactive periods, arrivals drop to 0-2 per day. The hidden state is whether a research session is active, and this state governs the arrival rate.
+
+Capacity sizing for such processes requires modeling the state transition dynamics (session start/end rates) and the arrival rates in each state, not just the time-averaged arrival rate.
+
+---
+
+Relevant Notes:
+- domains/internet-finance/_map
+
+Topics:
+- core/mechanisms/_map

domains/internet-finance/nonstationary-non-poisson-arrival-modeling-requires-rate-function-plus-dispersion-ratio-to-capture-burstiness.md

@@ -0,0 +1,34 @@
+---
+type: claim
+domain: internet-finance
+description: "CIATA method models time-varying bursty arrivals through combined rate and variance parameters"
+confidence: proven
+source: "Liu et al. (NC State), 'Modeling and Simulation of Nonstationary Non-Poisson Arrival Processes' (2019)"
+created: 2026-03-11
+---
+
+# Nonstationary non-Poisson arrival modeling requires rate function plus dispersion ratio to capture burstiness
+
+Standard Poisson process assumptions break down when arrivals exhibit correlation and burstiness. The CIATA (Combined Inversion-and-Thinning Approach) method models arrival processes through two parameters: a rate function λ(t) capturing time-varying intensity, and an asymptotic variance-to-mean (dispersion) ratio capturing burstiness beyond what the rate alone predicts.
+
+This two-parameter approach is necessary because time-varying rate alone cannot capture the correlation structure of bursty arrivals. A process with constant high variance but varying rate behaves fundamentally differently from a Poisson process with the same rate function.
+
+## Evidence
+
+Liu et al. demonstrate that CIATA models "target arrival processes via rate function + dispersion ratio — captures both time-varying intensity and burstiness." The paper shows that "replacing a time-varying arrival rate with a constant (max or average) leads to systems being badly understaffed or overstaffed," proving that rate variation alone is insufficient.
+
+The Markov-Modulated Poisson Process (MMPP) framework provides the theoretical foundation: "arrival rate switches between states governed by a hidden Markov chain — natural model for 'bursty then quiet' patterns." This captures the correlation structure that pure rate functions miss.
+
+## Relevance to Internet Finance
+
+This modeling framework directly applies to capital formation pipelines where research sessions create bursts of 10-20 source arrivals followed by quiet periods of 0-2 per day. The hidden state (research session active vs. inactive) governs the arrival rate, making this a textbook MMPP application.
+
+Capacity planning based on average arrival rates will systematically fail for such processes, leading to either chronic congestion during bursts or wasteful overcapacity during quiet periods.
+
+---
+
+Relevant Notes:
+- domains/internet-finance/_map
+
+Topics:
+- core/mechanisms/_map

inbox/archive/2019-00-00-liu-modeling-nonstationary-non-poisson-arrival-processes.md

@@ -6,8 +6,13 @@ url: https://yunanliu.wordpress.ncsu.edu/files/2019/11/CIATApublished.pdf
 date: 2019-01-01
 domain: internet-finance
 format: paper
-status: unprocessed
+status: processed
 tags: [pipeline-architecture, stochastic-modeling, non-stationary-arrivals, MMPP, batch-arrivals]
+processed_by: rio
+processed_date: 2026-03-11
+claims_extracted: ["nonstationary-non-poisson-arrival-modeling-requires-rate-function-plus-dispersion-ratio-to-capture-burstiness.md", "mmpp-models-session-based-bursty-arrivals-through-hidden-state-markov-chain.md", "constant-rate-approximation-of-time-varying-arrivals-causes-systematic-staffing-errors.md", "arrival-process-burstiness-increases-required-capacity-for-fixed-service-level.md"]
+extraction_model: "anthropic/claude-sonnet-4.5"
+extraction_notes: "Extracted four claims on nonstationary non-Poisson arrival modeling. Source provides theoretical foundation for MMPP modeling of bursty research pipeline arrivals. Key insight: rate function alone insufficient—dispersion ratio required to capture burstiness. Direct application to capital formation pipeline capacity planning where research sessions create burst arrivals. All claims rated 'proven' as this is peer-reviewed operations research establishing fundamental queueing theory results."
 ---
 
 # Modeling and Simulation of Nonstationary Non-Poisson Arrival Processes
@@ -26,3 +31,10 @@ Introduces the CIATA (Combined Inversion-and-Thinning Approach) method for model
 ## Relevance to Teleo Pipeline
 
 Our arrival process is textbook MMPP: there's a hidden state (research session happening vs. quiet period) that governs the arrival rate. During research sessions, sources arrive in bursts of 10-20. During quiet periods, maybe 0-2 per day. The MMPP framework models this directly and gives us tools to size capacity for the mixture of states rather than the average.
+
+
+## Key Facts
+- CIATA = Combined Inversion-and-Thinning Approach for modeling nonstationary non-Poisson processes
+- MMPP = Markov-Modulated Poisson Process where hidden Markov chain governs rate state transitions
+- MAP = Markovian Arrival Process, generalization of MMPP
+- Markov-MECO models interarrival times as absorption times of continuous-time Markov chain