NivaarExam PrepOfficial exam papers ↗

23-Ind-A6 Systems Simulation · May 2018

Question 5 of 9: Transient Behaviour and Welch's Warm-Up Method

Nivaar worked solution (AI-drafted; not reviewed by a licensed engineer)

Notes on this paper

National Exams — May 2018 — 17-Ind-A6 Systems Simulation. Three-hour, closed-book exam; one of two permitted calculators (Sharp or Casio), one 8.5″×11.0″ aid sheet (both sides). Format: three sections — Section A (four concept questions, candidates choose any two, 10 marks each, 20 marks total), Section B (three methods questions built around one continuing warehouse-simulation case study, candidates choose any two, 15 marks each, 30 marks total), Section C (two applications questions, candidates choose any one, 20 marks each). All nine questions are solved below for completeness. Two source anomalies are flagged where they occur: the front-page summary table states Section A is "Do 2 of 3," while Section A's own instructions and its four printed question sets read "two of the following four" — the printed four-question section is answered in full here; and Part C Question 2's sub-parts (a)–(c) are never printed anywhere in the paper, even though the results text for (d)–(f) explicitly refers back to "the factorial design matrix in (a)." Two-page Normal-distribution tables were supplied with the exam; the values below are the same table values obtained by direct computation.

Reference texts: Banks, Carson, Nelson & Nicol, Discrete-Event System Simulation (5th ed., Pearson) — random-number/random-variate generation, input modeling and goodness-of-fit testing, output analysis (warm-up, replication length, batch means vs. replication/deletion), and comparing alternative systems; Montgomery, Design and Analysis of Experiments (current ed., Wiley) — single-factor ANOVA, multiple comparisons, and 2k factorial designs with interaction analysis (Part C).

Question 5 (Part B.1): Transient Behaviour and Welch's Warm-Up Method (15 marks)

Question text not reproduced: the examination questions are © Engineers and Geoscientists BC. Open the official past paper (linked at the top of this page) to read the question, then follow the worked solution below.

Given. Hourly throughput from 3 pilot replications, $t=1,\dots,10$:

Pilot hourly throughput, 3 replications
Time $t$Rep 1Rep 2Rep 3
1354
2494037
3201919
4222424
5242020
6222525
7252022
8252124
9212024
10212425

Find. (a) transient vs. steady-state definitions; (b) why a warm-up period matters; (c) the warm-up period from Welch's technique with $w=1$.

Approach. Answer (a)/(b) conceptually; for (c), average across replications at each $t$, apply Welch's shrinking moving-window smoother with $w=1$, and read the warm-up length off where the smoothed series stops trending.

(a) Transient vs. steady-state. In the transient (initialization) phase, the distribution of the model's output at time $t$ still depends on the arbitrary initial conditions used to start the run (here, an empty, idle warehouse) and changes systematically with $t$. In steady-state, that dependence has died out — the output's distribution has settled into one that no longer depends on $t$ or on the starting conditions, so successive observations are statistically representative of the system's long-run behaviour rather than of how it happened to start.

(b) Why the warm-up period matters. Including transient-phase observations in a reported performance estimate biases it — typically low here, since an empty-and-idle warehouse understates the throughput the system achieves once loaded. Deleting a properly chosen warm-up period lets the estimator (mean throughput, utilization, …) reflect steady-state behaviour rather than a blend of ramp-up and steady operation, at the cost of discarding some simulated output and shrinking the effective sample used for the estimate.

(c) Welch's technique, $w=1$.

  1. Average across replications at each $t$. $\bar Y(t)=\big(\text{Rep1}+\text{Rep2}+\text{Rep3}\big)/3$:
    Cross-replication average and Welch $w=1$ moving average
    $t$12345678910
    $\bar Y(t)$4.0042.0019.3323.3321.3324.0022.3323.3321.6723.33
    $\bar w(t)$4.0021.7828.2221.3322.8922.5623.2222.4422.7823.33
    where $\bar w(t)=\dfrac{1}{2w+1}\displaystyle\sum_{s=-w}^{w}\bar Y(t+s)$ for interior $t$, shrinking to fewer terms at the two ends ($\bar w(1)=\bar Y(1)$, $\bar w(10)=\bar Y(10)$ when $w=1$).
  2. Plot and read off where the smoothed curve levels.
05101520253035404512345678910Time period t (hour)Throughputl = 4mean Ybar(t)Welch w=1 moving avg
Cross-replication mean throughput and its Welch $w=1$ moving average, with the read-off warm-up boundary.

After the sharp transient spike at $t=2$–$3$ (driven almost entirely by Replication 1's own startup surge), the smoothed series settles into a roughly constant $21$–$23$ band from $t=4$ onward and simply oscillates around that level for the rest of the run:

$$\boxed{l\approx4\text{ hours} \;(\text{delete the first 4 observations of every future run})}$$

ItemResult
(a)/(b)transient = still depends on initial conditions; delete it to avoid biasing the steady-state estimate
(c) warm-up period $l$$\approx4$ hours
steady-state mean (post warm-up, $t=5..10$)$\approx22.68$