Pediatric emergency department utilization during the COVID-19 pandemic in New York City
a b s t r a c t
Objectives: This study describes the utilization of a pediatric emergency department (ED) during the early months of the COVID-19 pandemic in the initial U.S. epicenter, including the impact on visit acuity and incidences of com- mon diagnoses.
Study Design: We performed an observational retrospective review of patients younger than 18 years old seen in a New York City pediatric ED from March 7th to May 6th 2020, and during the same time period in 2018 and 2019. Demographics, visit details, diagnoses, and dispositions were compared. Validated algorithms were utilized to create practical diagnosis groupings and to determine the probability of a visit requiring emergent evaluation. Results: ED visits during the pandemic decreased by 56% to an average Daily census of 67 patients, from an antic- ipated 152. Admission rates rose from 13.3% to 17.4% (p<0.001), and the proportion of Triage emergency severity index level 1 and 2 patients increased by 23.7% (p<0.001). Non-emergent visits dropped from 32.3% to 27.5% (p<0.001). Several common, often low-acuity diagnoses saw disproportionate reductions in visits including headache, chest pain, and minor injuries. Concerningly, visits for suicidal ideation, suicide attempt, or self- harm increased by 100% (p<0.001) and visits for evaluating abuse or neglect decreased by 89% (p=0.01).
Conclusions: Pediatric ED utilization substantially deceased during the early months of the COVID-19 pandemic in New York City, but left relatively higher patient acuity. healthcare systems in early epicenters must also prepare for the disproportionate impact a pandemic has on the most vulnerable pediatric patients, particularly those at risk for self-harm or abuse.
(C) 2021
Soon after the first patient in New York City (NYC) was diagnosed with the coronavirus disease of 2019 (COVID-19), the number of con- firmed cases in New York State (NYS) skyrocketed with NYC being la- beled the national epicenter of the pandemic [1]. State and city attempts to harness resources and stem the tide of infections escalated over the initial weeks, including a “NY on PAUSE” order limiting travel, business, and public gatherings.
Abbreviations: CCSR, Clinical Classification Software Refined; ED, Emergency Department; EMS, Emergency Medical Services; ESI, Emergency Severity Index; ICD-10- CM, International Classification of Diseases 10th Revision, Clinical Modification; ICU, Intensive Care Unit; LOS, Length of Stay; MERS, Middle East Respiratory Syndrome; NY, New York; NYC, New York City; PICU, pediatric intensive care unit; SARS, Severe Acute Respiratory Syndrome.
* Corresponding author at: Division of Pediatric Emergency Medicine, Cohen Children’s Medical Center, 269-01 76th Ave, New Hyde Park, NY 11040, USA.
E-mail address: [email protected] (W.C. Sokoloff).
Adult healthcare systems faced unparalleled challenges in patient vol- ume and acuity [2-5]. However, in line with prior coronavirus epidemics such as the 2003 severe acute respiratory syndrome (SARS) [6,7] and the 2014 Middle East respiratory syndrome [8] epidemics, pedi- atric emergency departments (ED’s) seemed to have been spared the same influx of patients [9-12]. Studies published to date in the U.S. have reported widespread reductions in pediatric volumes (59%-67%) and in- creases in acuity [13-16]. Notably though, the multicenter studies in the literature have overwhelmingly examined general ED’s rather than dedi- cated pediatric centers which have a higher proportion of medically com- plex pediatric patients [17]. Additionally, the studies to date consider a span of timepoints and a span of locations under varying levels of public health restrictions, but none focus on early epicenters of the U.S. pan- demic. The largest study by Hartnett et al. [13] did not include data from NYC while another study acknowledged as a limitation the low prevalence of COVID-19 in its location [18]. From an epidemiological and system preparedness standpoint, it is important to understand how the “first-wave” of a pandemic, as experienced in NYC where there
https://doi.org/10.1016/j.ajem.2021.02.029
0735-6757/(C) 2021
were public health restrictions and high community illness, will impact a pediatric healthcare system.
It was hypothesized that as a consequence of the increased isolation of children under the “NY on PAUSE” order, the prevalence of certain diag- noses would be more affected than others. This was particularly expected for various infectious illnesses, though Sheridan et al. [19] also described decreased pediatric ED visits for psychiatric complaints. It is unclear if these patterns hold true in a community with high disease prevalence.
By understanding the acuity and the pathology that present in the initial months of an active pandemic, we may prepare a healthcare sys- tem for pediatric resource needs during a future event. That includes identifying the most vulnerable Pediatric populations and developing innovative methods for providing them care. This study examines the effect the COVID-19 pandemic had on the demographics, diagnoses, and acuity seen by a pediatric ED in the first U.S. epicenter.
- Methods
- Settings and subjects
We conducted an observational, retrospective natural experiment study surrounding the COVID-19 pandemic in NYC. The pediatric ED at the focus of this study is located in the NYC borough of Queens, con- sidered part of the initial epicenter of the U.S. COVID-19 pandemic and serving communities prominently effected by governmental and self- imposed restrictions. It is a dedicated pediatric ED within a Tertiary care children’s hospital with a Level-1 pediatric trauma designation, car- ing for over 55,000 patients annually. The study period began March 7th, 2020, the day NYS announced a State of Emergency, and continued for two months until May 6th, 2020.
This study was approved by the Northwell Health Institutional Re- view Board and the Northwell Health COVID-19 Research Consortium.
-
- Data collection
All patients younger than 18 years old evaluated in the pediatric ED during the study period in 2020 were identified and included (“COVID”). We also identified all patients younger than 18 years old eval- uated in the pediatric ED during the same period in 2018 and 2019 (“Pre- COVID”), to serve as a proxy for what was anticipated absent the pan- demic. Information regarding demographics, mode of arrival, triage infor- mation, primary diagnosis, length of stay and disposition were collected through routinely created hospital analytic reports. Data missing from these reports was manually collected through a chart review.
We used several variables to assess for patient acuity and burden of illness. One such tool is the Emergency Severity Index triage tool [20], which is a common five-level ED triage stratification assigning pa- tients level 1 (most urgent) to 5 (least urgent) on the basis of acuity and anticipated resource needs. We also classified visits as emergent and non-emergent using the NYU-ED Algorithm [21] developed by the New York University Center for Health and Public Service Research. This validated tool uses International Classification of Diseases 10th Revi- sion, Clinical Modification (ICD-10-CM) Diagnosis codes to estimate the probability of an ED visit requiring Emergent medical care within 12 h. The algorithm does not categorize the urgency of visits related to alco- hol use, substance abuse, injuries, or mental health as well as other diag- noses the developers felt were not prevalent enough to confidently designate as emergent or not. Disposition of patients was also used as a surrogate measure of acuity.
Based on a patient’s primary ICD-10-CM code, visits were stratified into practical diagnosis groups using the Healthcare Cost and Utilization
Project’s Clinical Classification Software Refined (CCSR), version 2020.2 [22], which categorizes the over 70,000 ICD-10-CM codes into established groupings. The authors pre-selected several groupings for further analysis as they were felt to either represent a substantial per- centage of ED visits, be of particular clinical interest, or anecdotaly af- fected by the pandemic. Several infectious diagnoses such as “Fever” and “upper respiratory infection“, though common, were not selected for further analysis to avoid confounding by potential COVID-19 positive patients who were not tested.
-
- COVID-19 patients
During the early study period, the ability to test all suspected pa- tients for COVID-19 was severely limited and patients diagnosed with COVID-19 likely underrepresented the number of COVID-19 patients evaluated [23]. As such, for the purposes of the CCSR diagnosis group- ings, COVID-19 was recoded as ‘Viral Infection’, and for the NYU-ED Al- gorithm it was left as unclassified.
-
- Statistical analysis
When comparing patient visits from the COVID and Pre-COVID periods, categorical values were compared using Fisher’s exact test. Continuous values and comparison of means were evaluated using 2- tailed unpaired t-tests for both parametric and non-parametric data due to the large sizes [24]. Mean values are described with standard de- viation while proportions are described with 95% confidence intervals. Statistical significance was designated at p of 0.05. Statistical analyses were performed using SPSS 25 (IBM Inc., Armonk, NY, USA).
- Results
During the study period (COVID), there were 4068 patient visits in the pediatric ED, with an average daily census of 67 patients (range 30-164) (Fig. 1). This was 56.1% fewer visits than anticipated (9256 ex- pected visits with a Pre-COVID average daily census of 152, range 102-206). Demographic information for visits during the COVID period and Pre-COVID period is shown in Table 1. Mean age was not signifi- cantly different, though there were slight but statistically significant changes in age groups (p < 0.001) marked by a greater proportion of in- fants and adolescents compared to Pre-COVID. Table 2 displays assess- ments of acuity and illness burden. During the pandemic, the highest acuity ESI level 1 and 2 patients made up 18.8% of visits, compared to 15.2% of patients Pre-COVID (p < 0.001). The proportion of non- emergent visits had a 14.6% relative decrease from 32.3% of visits to 27.5% of visits (p < 0.001).
Overall admission rate during COVID was 17.4% with a relative risk of a patient being admitted 1.31 (CI95%: 1.21-1.41) compared to prior years, though this still equates to an absolute Reduction in admissions by 57%. Of those admitted, there was not a statistically significant differ- ence in the percentage of patients requiring ICU admissions (ICU: COVID 16.9% vs Pre-COVID 19.4%, Medical/surgical units: COVID 83.1% vs Pre- COVID 80.6%, p = 0.17).
Twenty-seven patients were given a diagnosis code for COVID-19 and recoded as earlier described. Table 3 displays the incidences of sev- eral pre-selected diagnoses, with some incidences disproportionately lower than the 56.1% decrease in overall visits. This was particularly true for generally low-acuity complaints including non-specific chest pain (-72%, p = 0.031), headaches (-79%, p < 0.001), minor injuries
(-73%, p < 0.001), and nausea/vomiting/diarrhea (-76%, p < 0.001). The largest decrease was for maltreatment and abuse (-89%, p = 0.01). Visits for suicidal ideation, suicide attempt or self-harm increased by 100% (p < 0.001) despite overall visits for psychiatric disorders de- creasing by 64% (p = 0.015).
Fig. 1. Average daily census. Study Period includes March 7th to May 6th. The solid line marks the daily census from the first reported COVID-19 case in NYS to six days after the COVID study period. The dashed line marks the average daily census during the Pre-COVID period.
0
10-May
1-Mar
8-Mar
15-Mar
22-Mar
29-Mar
5-Apr
12-Apr
19-Apr
26-Apr
3-May
Study Period
80
60
40
20
Pre-COVID Avg Daily Census
‘NYS on PAUSE’ order in effect
COVID Daily Census
120
100
NYC schools closed
140
Restrictions on Mass gatherings; Broadway closes
180
160
State of Emergency Declared for NYS
200
Table 1
Demographics
Pre-COVID (2018/19) |
COVID (2020) |
P-value |
||
% (n = 18,513) |
% (n = 4068) |
|||
Age, mean (SD) Age group (years), (%) |
7.3 years (5.5) |
7.1 years (5.8) |
0.07 <0.001 |
|
<1 |
12.5% (2319) |
16.2% (658) |
1-5 36.6% (6780) 36.6% (1487)
6-12 29.9% (5536) 24.7% (1003)
13-17 20.9% (3878) 22.6% (920)
Gender, Male (%) 54.0% (9997) 53.2% (2164) 0.36
Race (%)a <0.001
White/Caucasian 27.0% (4991) 25.3% (1029)
Black/African American 25.6% (4741) 22.1% (897)
Asian 15.6% (2887) 14.3% (580)
Other/Multiracial 30.0% (5562) 34.8% (1414)
Unknown/Declined 1.8% (332) 3.6% (148)
Ethnicity (%)a 0.038
Hispanic 18.1% (3342) 19.5% (793)
Non-Hispanic 78.9% (14607) 77.9% (3170)
Unknown/Declined 3.0% (564) 2.6% (105)
Insurance (%) <0.001
Private 41.0% (7590) 39.7% (1615)
Public 53.1% (9838) 56.4% (2296)
Self-pay/Uninsured 5.9% (1085) 3.9% (157)
During prior coronavirus epidemics (e.g., SARS, MERS) decreased pediatric ED visits were believed to be a result of the low pediatric dis- ease burden and the perceived risk of accessing healthcare during a
As the pandemic continues, the focus has been placed on how pedi- atric ED’s can best reallocate resources while also strategizing for a fu- ture pandemic [16,30]. Acuity and urgency are key factors. Similar to other sites, the early months of the pandemic in NYC saw acuity rise. The proportion of ESI 1 and 2 visits increased by 24% and admission rates increased by 31%. As ESI does not reflect final diagnoses, we also utilized the NYU-ED algorithm to evaluate how urgently patients re- quired an ED visit and found the number of visits that did not require emergent medical evaluation decreased by 14.6%.
To be prepared, pediatric ED’s monitor patterns of acuity, but also anticipate trends in diagnoses. Because children were confined home for much of the early pandemic, we expected increases in certain diag- noses such as accidental ingestions, burns, and foreign bodies. Though
Table 2
ED Burden of Severity and Acuity
Pre-COVID COVID P-value
% (n) % (n)
Mode of Arrival <0.001
Walk-In |
85.8% (15875) |
84.5% (3439) |
|
EMS/Transport |
13.7% (2532) |
15.5% (629) |
|
Unknown |
0.6% (106) |
0.0% (0) |
|
ESI 1 |
0.4% (69) |
0.2% (9) |
<0.001 |
2 |
14.8% (2743) |
18.6% (756) |
|
3 |
39.2% (7262) |
37.9% (1543) |
|
4 |
39.7% (7349) |
38.4% (1564) |
|
5 Disposition Transfer |
5.9% (1090) 0.4% (68) |
4.8% (196) 0.5% (21) |
<0.001 |
Discharge |
86.3% (15975) |
82.1% (3339) |
public health crisis [6,25,26]. The U.S. has not experienced such a signif- |
Admission |
13.3% (2470) |
17.4% (708) |
icant public health state of emergency prior to the COVID-19 pandemic. |
Admit-Medical/Surgical |
9.5% (1756) |
12.5% (510) |
In NYC, the pandemic uniquely compounded the reduced need for med- |
Admit-PICU |
2.3% (423) |
2.6% (104) |
ical evaluations due to milder pediatric disease [27-29], the perceived risk of exposure to the virus by presenting to an ED, hesitancy to utilize limited medical resources, and the comprehensive restrictions set by |
Admit-OR Admit-Psychiatry NYU-ED Urgency Emergent |
1.0% (178) 0.6% (113) 67.8% (6449) |
1.4% (57) 0.9% (37) <0.001 72.5% (1313) |
the “NY on PAUSE” order. In the course of our study period, there was |
Non-emergent |
32.2% (3064) |
27.5% (499) |
a 56% decrease in average daily volume as compared to prior years, within the range of the published literature to date [13-16].
Daily Census
Abbreviations: EMS, Emergency Medical Services; ESI, Emergency Severity Index; PICU, Pediatric Intensive Care Unit; OR, Operating Room.
Visits per 2-month study period by diagnosis
Diagnosis group(s) Pre-COVID (naverage)
COVID
(n)
Relative change
P-value
options for the most at-risk children. The charts of our suicidal patients included quotes such as “having stressors with current pandemic situa- tion and has not been able to see therapist” as well as “feeling anxious about online schoolwork since school has been cancelled.”
All diagnoses |
9256 |
4068 |
-56% |
n/a Our findings are consistent with literature examining children in |
Injuries, severea |
549 |
318 |
-42% |
<0.001 China [36] and the Netherlands [37] during the COVID-19 pandemic, |
Injuries, minorb |
677 |
181 |
-73% |
<0.001 quarantined individuals during the 2003 Toronto SARS epidemic [38], |
Abdominal pain |
550 |
196 |
-64% |
0.005 and individuals in NYS following the 9/11 terrorist attacks [39]: proximity |
760 |
184 |
-76% |
<0.001 to a pandemic or event epicenter and relationships with people afflicted |
|
Appendicitis |
80 |
85 |
+6.3% |
<0.001 |
Asthma |
368 |
103 |
-72% |
<0.001 by an event are associated with higher behavioral health concerns and |
Foreign body |
86 |
62 |
-28% |
0.001 ED utilization for behavioral health symptoms. These patterns suggest |
194 |
66 |
-66% |
0.051 that as social restrictions and disease prevalence rise during an epidemic, |
|
Urinary tract infections |
103 |
48 |
-53% |
0.74 healthcare systems and mental health providers should seek out their |
Headache, including migraine |
155 |
32 |
-79% |
<0.001 |
Non-specific chest pain |
93 |
26 |
-72% |
0.031 most high-risk patients to ensure continuity and resource availability, |
Convulsions or epilepsy |
167 |
89 |
-47% |
0.10 whether through telemedicine or behavioral health urgent care centers. |
Suicidal ideation/attempt or self-harm |
11 |
22 |
+100% |
<0.001 This study faces many of the common limitations of a retrospective re- |
497 |
180 |
-64% |
0.015 view including dependence on data collection systems that may have |
|
Poisoning by drugs |
21 |
14 |
-33% |
0.15 missing or incorrect information. Additionally, the single-center nature |
Hemolytic jaundice and perinatal jaundice |
27 |
22 |
-19% |
0.011 of the study limits generalizability; though our broader findings of de- |
a Includes fractures, open wounds and lacerations.
Diabetes mellitus with complication |
16 |
13 |
-19% |
0.046 |
creased visits and higher acuity reflect national patterns and our more |
Burns Maltreatment/abuse |
15 28 |
11 3 |
-27% -89% |
0.12 0.01 |
granular results highlight the unique severity of restrictions and disease prevalence initial epicenters may face during a pandemic. Unique to this |
b Includes contusions, superficial injuries, concussions, sprains and strains, musculo- skeletal pain, and low back pain.
c Includes nausea and vomiting, non-infectious gastroenteritis, and intestinal infection.
d Includes anxiety disorders, bipolar disorders, Depressive disorders, conduct disorders, Mood disorders, schizophrenia spectrum disorders, psychotic disorders, and trauma re- lated disorders.
e Not a routine CCSR grouping.
these visits did not increase as hypothesized, they did not drop nearly as much as the overall ED volume.
As predicted, low acuity complaints such as chest pain, headache, minor injuries, and nausea/vomiting/diarrhea decreased substantially. Interestingly, the diagnosis of abdominal pain considerably decreased while appendicitis did not. Therefore, children presenting with undiffer- entiated abdominal pain were more likely to have a true appendicitis.
One dramatic and concerning change in presentations is the 89% decrease in primary diagnoses for child abuse or maltreatment. This pattern has yet to be described elsewhere in the literature and unmis- takably should not be affected by changes in ED volume alone. Indeed, during a similar time period, NYC’s Administration for Children’s Ser- vices received 51% fewer reports of neglect or abuse [31]. Though the cause is likely multifactorial, it is predominantly attributable to children’s lack of exposure to mandated reporters, rather than such a dramatic decrease in incidences of abuse and neglect [32,33]. Data on this population and potentially missed sentinel events will need to be followed closely as the pandemic continues. Public health agencies must keep a heightened awareness of this trend to drive Novel methods for intervening and monitoring children early in pandemics or crises.
An additional concerning discovery is the doubling of visits for sui- cidal ideation, suicide attempts, or self-injury. Though comparatively small in absolute numbers, the 100% relative increase is in stark contrast to the considerable decrease in overall behavioral health visits seen in our ED and in others’ [15,19]. Children across the country are socializing less and enduring new pandemic-related stressors on their families. We postulate our unique finding of increased suicidality and self-harm is in- part a consequence of the relatively higher media attention, severity of stressors such as parental job loss, and high prevalence of COVID-19 in the NYC area during the study period. For reference, by the end of July 2020, 1 in 520 children in Queens experienced the death of a parent or caregiver to COVID-19, more than any other county in NYS [34]. In addition, access to mental health services in NYC communities was se- verely restricted, particularly for those who receive school-based ser- vices [35]. As many telehealth opportunities had not yet been initiated, this meant removing preventative and crisis management
study is the inclusion of the NYU-ED Algorithm which, though previously validated [40] and utilized in the pediatric literature [41], does have inher- ent limitations in excluding particular diagnoses. However, as our study compares findings from year-to-year, the relative change is more mean- ingful than the absolute findings of one year’s numbers.
Timing of the study must also be considered. As Fig. 1 displays, pa- tient volume was higher during the earliest weeks of the pandemic, thus potentially skewing our results towards earlier trends. The COVID study period also preceded the Surge of patients in NYS with Multisys- tem Inflammatory Syndrome of Childhood (MIS-C) [42] who would likely increase the acuity and illness burden in the ED.
- Conclusions
During the early months of the COVID-19 pandemic in NYC, our pe- diatric ED saw unprecedented decreases in volume. However, the resulting patient population seeking ED care was of higher acuity, more likely to warrant emergent evaluation, and more likely to require hospitalization. As healthcare systems develop resource strategies for the current and potential future pandemics, community outreach and vigilance should target the most vulnerable pediatric patients, particu- larly those at high risk for self-harm or abuse who have been dispropor- tionately affected.
Disclosure
The authors declare no conflicts of interest.
Funding
This research did not receive any specific grant from funding agen- cies in the public, commercial, or not-for-profit sectors.
Declaration of Competing Interest
None.
References
- Hasan Z, Narasimhan M. Preparing for the COVID-19 pandemic: our experience in New York. Chest. 2020;157(6):1420-2. https://doi.org/10.1016/j.chest.2020.03.027.
- Flores S, Gavin N, Romney ML, Tedeschi C, Olsen E, Heravian A, et al. COVID-19: New York City pandemic notes from the first 30 days. Am J Emerg Med. 2020;38(7): 1534-5. https://doi.org/10.1016/j.ajem.2020.04.056.
- Ammar A, Stock AD, Holland R, Gelfand Y, Altschul D. Managing a specialty service during the COVID-19 crisis: lessons from a New York City health system. Acad Med. 2020. https://doi.org/10.1097/ACM.0000000000003440.
- Konda SR, Dankert JF, Merkow D, Lin CC, Kaplan DJ, Haskel JD, et al. COVID-19 response in the global epicenter: converting a New York City level 1 ortho- pedic trauma service into a hybrid orthopedic and medicine COVID-19 management team. J Orthop Trauma. 2020;34(8):411-7. https://doi.org/10.1097/ BOT.0000000000001792.
- Philips K, Uong A, Buckenmyer T, Cabana MD, Hsu D, Katyal C, et al. Rapid imple- mentation of an adult coronavirus disease 2019 unit in a Children’s hospital. J Pediatr. 2020;222:22-7. https://doi.org/10.1016/j.jpeds.2020.04.060.
- Boutis K, Stephens D, Lam K, Ungar WJ, Schuh S. The impact of SARS on a tertiary care pediatric emergency department. CMAJ. 2004;171(11):1353-8. https://doi. org/10.1503/cmaj.1031257.
- Heiber M, Lou WY. Effect of the SARS outbreak on visits to a community hospital emergency department. CJEM. 2006;8(5):323-8. https://doi.org/10.1017/ s148180350001397x.
- Lee SY, Khang YH, Lim HK. Impact of the 2015 Middle East respiratory syndrome outbreak on Emergency care utilization and mortality in South Korea. Yonsei Med
J. 2019;60(8):796-803. https://doi.org/10.3349/ymj.2019.60.8.796.
- Lazzerini M, Barbi E, Apicella A, Marchetti F, Cardinale F, Trobia G. Delayed access or provision of care in Italy resulting from fear of COVID-19. Lancet Child Adolesc Health. 2020. https://doi.org/10.1016/S2352-4642(20)30108-5.
- Clavenna A, Nardelli S, Sala D, Fontana M, Biondi A, Bonati M. Impact of COVID-19 on the pattern of access to a pediatric emergency Department in the Lombardy Region. Italy Pediatr Emerg Care. 2020. https://doi.org/10.1097/PEC.0000000000002232.
- Isba R, Edge R, Jenner R, Broughton E, Francis N, Butler J. Where have all the children gone? Decreases in paediatric emergency department attendances at the start of the COVID-19 pandemic of 2020. Arch Dis Child. 2020;105(7):704. https://doi.org/10. 1136/archdischild-2020-319385.
- Levine DA, Fraymovich S, Platt SL. Where have all the children gone? Pediatric per- spectives on COVID-19 in New York City. Ann Emerg Med. 2020;76(1):109-10. https://doi.org/10.1016/j.annemergmed.2020.04.035.
- Hartnett KP, Kite-Powell A, DeVies J, Coletta MA, Boehmer TK, Adjemian J, et al. Im- pact of the COVID-19 Pandemic on Emergency Department Visits - United States, January 1, 2019-May 30, 2020. MMWR Morb Mortal Wkly Rep. 2020;69(23):
699-704. https://doi.org/10.15585/mmwr.mm6923e1.
- Pines JM, Zocchi MS, Black BS, Carlson JN, Celedon P, Moghtaderi A, et al. Character- izing pediatric emergency department visits during the COVID-19 pandemic. Am J Emerg Med. 2020. https://doi.org/10.1016/j.ajem.2020.11.037.
- Chaiyachati BH, Agawu A, Zorc JJ, Balamuth F. Trends in pediatric emergency depart- ment utilization after institution of coronavirus Disease-19 mandatory social dis- tancing. J Pediatr. 2020. https://doi.org/10.1016/j.jpeds.2020.07.048.
- Even L, Lipshaw MJ, Wilson PM, Dean P, Kerrey BT, Vukovic AA. Pediatric emergency department volumes and throughput during the COVID-19 pandemic. Am J Emerg Med. 2020. https://doi.org/10.1016/j.ajem.2020.09.074.
- Murtagh Kurowski E, Byczkowski T, Grupp-Phelan JM. Comparison of emergency care delivered to children and young adults with complex chronic conditions be- tween pediatric and general emergency departments. Acad Emerg Med. 2014;21 (7):778-84. https://doi.org/10.1111/acem.12412.
- Pines JM. Freestanding emergency department visits and disasters: the case of hur- ricane Harvey. Am J Emerg Med. 2018;36(8):1513-5. https://doi.org/10.1016/j. ajem.2018.01.016.
- Sheridan DC, Cloutier R, Johnson K, Marshall R. Where have all the emergency pae- diatric mental health patients gone during COVID-19? Acta Paediatr. 2020. https:// doi.org/10.1111/apa.15537.
- Emergency Severity Index : A Triage Tool for Emergency Departments Rock- ville, MD: Agency for Healthcare Research and Quality. https://www.ahrq.gov/ professionals/systems/hospital/esi/index.html; 2018. [accessed April 27].
- Billings J. NYU ED Algorithm New York, NY: NYU Center for Health and Public Ser- vice Research. https://wagner.nyu.edu/faculty/billings/nyued-background.
- Clinical Classifications Software Refined (CCSR) for ICD-10-CM Diagnoses v2020.2 Rockville, MD. Agency for Healthcare Research and Quality; 2020https://www. hcup-us.ahrq.gov/toolssoftware/ccsr/ccs_refined.jsp [accessed April 14].
- Rosenberg ES, Hall EW, Rosenthal EM, Maxted AM, Gowie DL, Dufort EM, et al. Mon- itoring coronavirus disease 2019 (COVID-19) through trends in influenza-like ill- ness, laboratory-confirmed influenza, and COVID-19-New York state, excluding
New York City, 1 January 2020-12 April 2020. Clin Infect Dis. 2020. https://doi. org/10.1093/cid/ciaa684.
- Fagerland MW. t-tests, non-parametric tests, and large studies-a paradox of statisti- cal practice? BMC Med Res Methodol. 2012;12:78. https://doi.org/10.1186/1471- 2288-12-78.
- Stockman LJ, Massoudi MS, Helfand R, Erdman D, Siwek AM, Anderson LJ, et al. Se- vere acute respiratory syndrome in children. Pediatr Infect Dis J. 2007;26(1): 68-74. https://doi.org/10.1097/01.inf.0000247136.28950.41.
- Memish ZA, Al-Tawfiq JA, Assiri A, AlRabiah FA, Al Hajjar S, Albarrak A, et al. Middle East respiratory syndrome coronavirus disease in children. Pediatr Infect Dis J. 2014; 33(9):904-6. https://doi.org/10.1097/INF.0000000000000325.
- Kim L, Whitaker M, O’Halloran A, Kambhampati A, Chai SJ, Reingold A, et al. Hospi- talization rates and characteristics of Children Aged <18 years hospitalized with laboratory-confirmed COVID-19 - COVID-NET, 14 States, March 1-July 25, 2020. MMWR Morb Mortal Wkly Rep. 2020;69(32):1081-8. https://doi.org/10.15585/ mmwr.mm6932e3.
- CDC Covid-Response Team. Coronavirus Disease 2019 in Children - United States, February 12-April 2, 2020. MMWR Morb Mortal Wkly Rep. 2020;69(14):422-6. https://doi.org/10.15585/mmwr.mm6914e4.
- Kainth MK, Goenka PK, Williamson KA, Fishbein JS, Subramony A, Schleien C, et al. Early experience of COVID-19 in a US Children’ Hospital. Pediatrics. 2020. https:// doi.org/10.1542/peds.2020-003186.
- Walker DM, Tolentino VR. COVID-19: the effects on the practice of pediatric emer- gency medicine. Pediatr Emerg Med Pract. 2020;17(Suppl 6-3):1-15. https:// www.ncbi.nlm.nih.gov/pubmed/32549038.
- Stewart N. Child abuse cases drop 51 percent. The Authorities Are Very Worried The New York Times June 9; 2020. https://www.nytimes.com/2020/06/09/nyregion/ coronavirus-nyc-child-abuse.html.
- US Department of Health & Human Services; Administration for Children and Families; Administration on Children Youth and Family, Children’s Bureau 2018, Child Maltreatment. 2020 https://www.acf.hhs.gov/cb/research-data-technology/ statistics-research/child-maltreatment.
- Welch M, Haskins R. What COVID-19 means for America’s child welfare system. Brookings Institution; April 30, 2020. https://www.brookings.edu/research/what- covid-19-means-for-americas-child-welfare-system/.
- Brundage SC, Ramos-Callan K. COVID-19 ripple effect: the impact of COVID-19 on children in New York State. United Hospital Fund September 30; 2020. https:// uhfnyc.org/publications/publication/covid-19-ripple-effect-impact-covid-19- children-new-york-state/.
- Torres-Pagan L, Terepka A. School-based health centers during academic disruption: challenges and opportunity in urban mental health. Psychol Trauma. 2020;12(S1). https://doi.org/10.1037/tra0000611 S276-S8.
- Jiao WY, Wang LN, Liu J, Fang SF, Jiao FY, Pettoello-Mantovani M, et al. Behavioral and emotional disorders in children during the COVID-19 epidemic. J Pediatr. 2020;221:264-6. https://doi.org/10.1016/j.jpeds.2020.03.013 e1.
- Luijten MAJ, van Muilekom MM, Teela L, van Oers HA, Terwee CB, Zijlmans J, et al. The impact of lockdown during the COVID-19 pandemic on mental and social health of children and adolescents. medRxiv. 2020. https://doi.org/10.1101/2020.11.02. 20224667.
- Cava MA, Fay KE, Beanlands HJ, McCay EA, Wignall R. The experience of quarantine for individuals affected by SARS in Toronto. Public Health Nurs. 2005;22(5): 398-406. https://doi.org/10.1111/j.0737-1209.2005.220504.x.
- DiMaggio C, Galea S, Richardson LD. Emergency department visits for behavioral and mental health care after a terrorist attack. Ann Emerg Med. 2007;50(3):327-34. https://doi.org/10.1016/j.annemergmed.2006.10.021.
- Ballard DW, Price M, Fung V, Brand R, Reed ME, Fireman B, et al. Validation of an al- gorithm for categorizing the severity of hospital emergency department visits. Med Care. 2010;48(1):58-63. https://doi.org/10.1097/MLR.0b013e3181bd49ad.
- Ben-Isaac E, Schrager SM, Keefer M, Chen AY. National profile of nonemergent pedi- atric emergency department visits. Pediatrics. 2010;125(3):454-9. https://doi.org/ 10.1542/peds.2009-0544.
- Capone CA, Subramony A, Sweberg T, Schneider J, Shah S, Rubin L, et al. Character- istics, cardiac involvement, and outcomes of multisystem inflammatory syndrome of childhood associated with severe acute respiratory syndrome coronavirus 2 infec- tion. J Pediatr. 2020;224:141-5. https://doi.org/10.1016/j.jpeds.2020.06.044.