1 of 25

��Applying Queueing Theory and Simulation to the Modeling of Emergency Departments

Summer (Xia) Hu

Sean Barnes

Bruce Golden

University of Maryland, College Park

1

Jul. 31 2015

2 of 25

Emergency Department (ED) Crowding

2

  • Critical challenge to operational efficiency
  • Increase in ED visits, decrease in ED number

Patients

Providers

  • Higher risks of morbidity and mortality
  • Prolonged wait times
  • Higher likelihood of leaving without being seen (LWBS)
  • Higher rates of dissatisfaction
  • Higher rates of medical errors
  • Miscommunication & stress 
  • Lower productivity and morale
  • Negative influence on teaching mission in academic EDs
  • Reduced ability responding to mass casualty incidents

Negative Effects

3 of 25

Queueing Theory (QT)

3

  • Classical operations research methodology based upon mathematical models
  • Natural fit for modeling patient flow in a healthcare setting

  • Advantages
  • Closed-form analytical solution
  • Minimal data requirements
  • Easy implementation via spreadsheets

4 of 25

Challenges In ED Queueing Modeling

4

  • Time-varying demand
  • Various patient flow routes

  • ED patients are prioritized and treated according to their assessed level of urgency, not according to their arrival time or a pre-determined schedule

5 of 25

Descriptive Analysis By Year

5

  • Analytical QT articles focused exclusively on ED operations
  • 39 articles published during 1970-2014
  • Limited publications before 2005
  • Increasing interest of researchers in this domain

6 of 25

Descriptive Analysis By Publication Outlets

6

  • ED QT method are attracting increased attention from traditional healthcare areas, then from engineering, and finally from healthcare management and operations research

  • Operations Research and Management Science (ORMS) journals published the most QT-related ED articles, followed closely by the Emergency, Health and Medicine Science (EHM) journals

7 of 25

Performance Measures

7

Example: Governmental policy evaluation

  • [L. Mayhew & D. Smith, 2008] used a queueing model to evaluate the length of stay in UK EDs in light of the government-enforced target of completing and discharging 98% of patients within 4 hours
  • They demonstrated how the model could be used to assess the practicality of ED targets in the future

ED Performance Measures

Number of Articles

Time

Expected Wait Time

9

Average Length of Stay

3

Length of Stay

4

Expected Boarding Time

2

Fraction of Time On Diversion

1

Queue

Average Queue Length

3

LWBS Rate

4

Probability

Wait Probability

6

Area Overflow Probability

3

Blocking Probability to Inpatient Unit

1

Resource

Resource Utilization

5

Marginal Resource (bed)

1

8 of 25

Problem-Oriented Perspective

8

Recall ED Procedure:

Two Perspectives:

9 of 25

Demand-Oriented Problems

9

  • Arrival Pattern
  • Problem 1: Time-varying arrival

  • Solution
  • Piecewise Stationary Approximation (PSA)
  • Stationary Independent Period by Period (SIPP)

10 of 25

10

  • Arrival Pattern
  • Problem 2: Time-lag between arrival and occupancy (enduring effect)

  • Solution
  • Lag-version of above models (i.e., Lagged-PSA, Lagged SIPP): shift the arrival rate to the right by the mean service time

11 of 25

11

  • A Common Underlying Assumption
  • Arrival and service rates may depend on time, but do not depend on the system state (e.g., occupancy)
  • Future research should try incorporating this behavior

12 of 25

  • Ambulance Diversion

  • EDs requesting Emergency Medical Services (EMS) divert incoming ambulances to neighboring hospitals during periods of overcrowding.
  • Pros: Decrease the load on an ED
  • Cons: Put patients at risk of worse outcomes; Lost revenue to the hospital

Example:

[G. Allon, S. Deo, et al.]: The capacity of the inpatient unit is negatively correlated with the fraction of time that the ED diverts ambulances. Minimum number of beds is positively correlated with the fraction of time spent on active diversion.

12

13 of 25

  • Priority Queue: Triage-based

  • Pros: Reduce the average wait time for all patients (e.g. lower-acuity patients in fast track)
  • Cons: The wait time for higher priority patients is reduced while the lower-priority patients endured longer wait times on average.

  • Fast track decrease LWBS rate
  • Split-flow saves resources by keeping the low-acuity patients vertical

13

14 of 25

  • LWBS - reneging
  • Influenced by wait time, queue length and observed progress of other patients while waiting
  • In systems where demand exceeds server capacity, reneging is the only way that a system attains a state of dysfunctional equilibrium

Example: [J.K. Cochran, J. R. Broyles, 2010] explored the relationship between LWBS and ED utilization by approximating reneging using queueing with balking. They predicted future ED capacity based on patient safety (rather than congestion measures).

14

Such queue-based relationship is superior to the typical ad hoc regression relationships commonly found

15 of 25

Supply-Oriented Problems: Resource

15

Studies focused on the estimation of the necessary amount of ED resources can be classified into two types:

  • Steady state resource requirements

- Use QT to estimate the steady state resource requirement. Then adjust resource levels to meet the daily fluctuations in demand in specific ED

  • Short-term resource adjustments

- Use autoregressive integrated moving average models, Monte Carlo simulation and Markov Decision Processes to determine resource levels as a function of time

16 of 25

Recall Kendall’s Notation

16

Typical Values:

  • A and B: M - exponential, D - deterministic, PH - phase type, GI- general independent (i.i.d.), and G - general distribution
  • When the final three parameters are not specified (e.g. M/M/1), it is assumed K = ∞, N = ∞ and D= first-in, first-out
  • +G: abandonment is allowed with an arbitrary patience distribution time

Queueing system A/B/m/K/n/D

A

Probability distribution of the inter-arrival times

B

Probability distribution of the service times

m

Number of servers

K

Capacity of the system including patients in service (K ≥ m)

n

Size of the source population

D

Queueing discipline

17 of 25

Modeling-Oriented Perspective

17

  • Infinite-capacity model

  • G/G/c queue
  • Popularity of M/M/c queue.

e.g., (N. Yankovic, L.V. Green, 2011) modified M/M/c queue

  • Approximate general distribution by other distribution

  • Finite-capacity model

  • m/m/c/k model: used to make capacity decisions for the EDs
  • When c=k, Erlang loss formula can be used to calculate
  • overflow probability
  • Capacity requirement

e.g., (A.M. de Bruin et al., 2007)

Queueing Model

# of Articles

Infinite Capacity

G(t)/G/c(t)

M/M/c

9

M/M/c//n (infinite source)

1

M/M/1

1

M/G/1

1

M/M/ ∞

2

M/G/c

3

D/G/1

1

Mt/G/ct

1

G/GI/c/c

1

GI/G/ct

1

Finite Capacity

G/G/c/k

M/M/c/k

1

M/M/1/k

2

M/M/c/c

1

M/G/c/c

1

M/GI/c/c

1

Queue With Abandonment

M/M/n + G

1

Mt/M/n + G

1

M/GI/r/s +GI

(Approximate to M/M/r/s + M(n))

1

 

Markov Decision Process

Bivariate

1

2-Stage

3

18 of 25

Modeling-Oriented Perspective

  • View the ED as an Independent Queueing System
  • View ED as a node in Queueing Networks
  • Hospital as the big network
  • ED + IU network

18

Article

QT

Assumption

[MM2012]

 

Inverted-V-shaped queueing system

A single centralized queue and k heterogeneous wards; each ward contains Ni i.i.d servers (beds). Upon arrival, each patient is routed to one available pool if it has idle servers, or joins a centralized queue of infinite capacity if all the servers are busy

[LPL2014]

M/GI/ c1/∞ with priority, and G/GI/ c2/ c2

 

ED queue: five priority patients; high priority patients receive immediate service; Patient either discharge, or transfer to IUs after ED, depending on the availability of IU beds; IU queue: no priorities or buffer. Resource is bed capacity in the ED and IU. Each resource has a capacity of one

[BC2011]

Two multi-server M/M/c queue in series

Service rate for ED, IU is unknown and estimated by statistical methods. Resource is bed for both queues

[ADL]

M/M/(N1 − B) and M/M/N2/K queue (approximated)

Two priority patients as two queues; independent poison arrival rates to the ED and admission rates to the IU; each station has multiple servers (beds); hospital diverted patients if there were more than K boarded patients in the ED

19 of 25

ED QT & Simulation

  • Simulation

- Great flexibility in testing scenarios, hypotheses, policies, and re-engineering ideas

  • Our Procedure
  • Examine ED QT papers that simultaneously implement simulation for double validation purpose
  • Examine Papers that combine QT with simulation from the modeling perspective

19

20 of 25

QT & Simulation Double Validation In the Same Paper

  • Achieved very close results from both models
  • Observed variations
  • Can help to compare different QT models

20

Papers

Simulation Purpose

QT/ Simulation Results Comparison

[YG2011]

Test reliability/assumption robustness of QT model; examine the impact of ALOS

QT model’s staffing estimates are reliable under various distribution hypothesis, with occasional underestimation of delays when ALOS is short

[CR2009]

Check performance measures

Performance measures are consistent

[LPL2014]

Validate the impact of variables on necessary ED capacity

Achieved very close results

 

[SAG2013]

QT model to validate simulation model

The wait times predicted by the QT model are lower than the simulation model.

[YM2014]

Validate QT models in large and small system to pinpoint unfitness; Compare staffing given by two QT models

In large system, the QT and simulation performance fit closely in the QED regime, but not necessarily for the efficiency driven system.

[XC2014]

Verify the insights generated by QT model on ED admission control

Simulation verified that the proactive policies based on QT are robust under the variation of parameters

[AIM]

Simulation model as an acute measure of performance

21 of 25

QT & Simulation Double Validation In the Same Paper

21

Results:

Compared with the Mt/Mt/ ∞ model which fits well only when ED patient number is small and Mt/Mi/ ∞ model which is even less accurate, the state dependent model Mi/Mi/ ∞ has an overall good fit with simulation and real system performance

Example:[AIM]

Simulation Purpose:

Test how the number of patients in ED depends on time and state of the system for different QT models

22 of 25

QT in Combination with Simulation

  • Combination of simulation with queueing techniques leads to theoretical insights and practical results
  • Queueing models enables analytical formula derivation for the general cases
  • Simulation models can validate, refine, or complement the results obtained by queueing theory

22

Papers

Purpose

How QT is combined with simulation

[ZC2009]

Utilization

Improvement

  • Square-root-staffing in conjunction with the M/M/s queue
  • Set staffing level

[LW2012]

Congestion Alleviation

  • QT network with a heuristic iterative algorithm
  • A specific delay probability simulation is used to estimate the percentage discharged during 4 hours

[HF2009]

AD routing Policy

  • First derived a small scale QT model to generate the corresponding qualitative solution
  • Then applied DES and Agent-based simulation model to mimic the full-scale network

23 of 25

Conclusion

  • Queueing Models
  • Invaluable tools for ED design and management
  • The larger the system, the better performance
  • Cannot capture all of the characteristics of an actual ED, and may predict less variability than the real system experiments
  • Tend to simplify the system and underestimate delays and congestions, and thus obtain less accurate results than from simulation

23

  • Simulation Models
  • Have the advantage of incorporating more detailed behavior
  • Can help to validate, refine or compare queueing models, and estimate missing parameters in queueing models, if necessary
  • Can be sensitive to specific ED settings

24 of 25

Future Direction

  • Queueing models of the ED settings are still limited despite the abundance of established theoretical work

  • Future QT research in ED may consider incorporating state dependence into modeling

  • Combination of QT with simulation or statistics will help to solve many realistic problems (e.g., parallel/ sequential task modeling from care providers, time inhomogeneity of arrivals, ED re-visiting), while conserving QT’s advantage of generating analytical and generalizable results for tractable models

24

25 of 25

Thank you!

Summer (Xia) Hu

University of Maryland, College Park

xhu64@umd.edu

25