|
A PHYSICAL ACTIVITY QUESTIONNAIRE: REPRODUCIBILITY AND VALIDITY
|
1Sport Medicine Program, 2Epidemiology Program, Medicine Faculty,
El Bosque University Bogotá, Colombia; 3Physiology Laboratory of Adaptations,
Medicine Faculty, Cochin Port Royal, MAP5 UMR CNRS 8145, 4Paris Descartes
University , Paris, France.
| Received |
|
19 February 2007 |
| Accepted |
|
19
September 2007 |
| Published |
|
01
December 2007 |
©
Journal of Sports Science and Medicine (2007) 6, 505- 518
Search
Google Scholar for Citing Articles
| ABSTRACT |
| This study evaluates the Quantification de L'Activite Physique
en Altitude chez les Enfants (QAPACE) supervised self-administered
questionnaire reproducibility and validity on the estimation of the
mean daily energy expenditure (DEE) on Bogotá's schoolchildren. The
comprehension was assessed on 324 students, whereas the reproducibility
was studied on a different random sample of 162 who were exposed twice
to it. Reproducibility was assessed using both the Bland-Altman plot
and the intra-class correlation coefficient (ICC). The validity was
studied in a sample of 18 girls and 18 boys randomly selected, which
completed the test - re-test study. The DEE derived from the questionnaire
was compared with the laboratory measurement results of the peak oxygen
uptake (Peak VO2) from ergo-spirometry and Leger Test.
The reproducibility ICC was 0.96 (95% C.I. 0.95-0.97); by age categories
8-10, 0.94 (0.89-0. 97); 11-13, 0.98 (0.96- 0.99); 14-16, 0.95 (0.91-0.98).
The ICC between mean TEE as estimated by the questionnaire and the
direct and indirect Peak VO2 was 0.76 (0.66) (p<0.01);
by age categories, 8-10, 11-13, and 14-16 were 0.89 (0.87), 0.76 (0.78)
and 0.88 (0.80) respectively. The QAPACE questionnaire is reproducible
and valid for estimating PA and showed a high correlation with the
Peak VO2 uptake.
KEY
WORDS: Physical
activity, questionnaire, validity, children, adolescents.
|
| INTRODUCTION |
|
The increase in physical activity (PA) in young ages could prevent
or delay the onset of adult pathological states (Pols et al., 1997).
PA can be objectively measured by different methods some of which
require special equipment and are not very well adapted to a large
sample study of children. Questionnaires, interviews and diaries
represent subjective methods for estimating PA, which are usually
preferred in epidemiological studies.
Objective methods for measuring PA combine video, movement's counters,
accelerometer, heart rate monitoring, blood pressure monitoring,
electromyography, anthropometry, fitness, VO2 metabolic
cart or VO2 portable equipment, respiration chamber and
doubly labelled water (DLW). However, they require special equipment
and are not very well adapted to a large sample study of children.
Questionnaires, interviews and diaries represent subjective methods
for estimating PA, which are usually preferred in epidemiological
studies. A supervised self-administered questionnaire appeared as
the most feasible and economically appropriate approach to address
the specific objective of the Bogotá study. However, a PA questionnaire
must fulfill the following criteria i) non-reactiveness, i.e. it
does not alter the behavior of the study population; ii) practicability;
iii) applicability, i.e. it is particularly designed to suit the
population; and iv) accuracy, i.e. it is reliable and valid (Caspersen
et al., 1998).
An activity questionnaire is valid when it is able to rank individuals
or groups of subjects within a population from the least to the
most active, with a good correlation with relevant physiologic parameters
or disease outcomes (Kriska and Caspersen, 1997).
Little is known about PA in Latin American children thus an epidemiological
study was launched by the El Bosque University (COL) and Paris Descartes
University (FRA) to evaluate PA in youngsters in Bogotá.
Questionnaires for quantification of PA are strongly dependent on
the notion of "compendium of PA" (Ainsworth et al., 2000),
which allows for an estimation of the total energy expenditure as
a summation of specific activities defined by their intensity and
duration and expressed in metabolic equivalents (Mets) in relation
to body mass.
Many questionnaires have shown good reliability in adults (Ainsworth
et al., 2000;
Friedenreich et al., 1998),
but, for youngsters some of the validity correlations were non significant
or low (Sallis et al, 2000).
In the literature, the measurements derived from PA questionnaires
in adults have been usually compared either with a direct PA assessment
like self- report logging procedures, heart rate monitoring and
accelerometers, or with indirect indicators like maximal aerobic
capacity, dietary intake or percent body fat (Booth et al., 2002;
Philippaerts and Lefevre, 1998;
Rauh et al., 1992;
Washburn et al., 2003).
The maximal oxygen uptake is often commonly used for validation
purposes, although the functional capacity is influenced by age,
gender, altitude and other factors. The measurement of maximal oxygen
uptake is chosen because of its biological proxy of physical activity
(Saris, 1996)
and has been measured using two methods previously used in validity
studies (Booth et al., 2002,
Washburn et al., 2003).
Therefore, the aim of the study was to develop a specific questionnaire,
the QAPACE (Quantification de l'Activite Physique en Altitude Chez
le Enfants) and to assess the reproducibility and validity of this
questionnaire.
| METHODS |
|
The
Paris Descartes University (Paris, France) approved the design,
while the Secretaría de Educación de Bogotá, the application.
None of the schools refused to participate and informed consent
was requested from all students and their parents.
The
proposed questionnaire
Different questionnaires have been developed for measuring
PA (Aaron et al., 1993;
1995;
Bouchard et al., 1983;
Kriska, 1997).
QAPACE (see Appendix),
is self-administered and supervised and 18 questions were
developed according to 13 categories (Table
1) of daily physical activities, covering all the possible
school or vacation activities of the youth over the past year.
Construction
of the questionnaire
Several questionnaires and methods were developed until the
best ways of approach and introduction in a school were found.
Volunteers from among the senior physicians, belonging to
the permanent staff of the departments of either Community
Medicine or Pediatrics or Sport Medicine from the El Bosque
University were invited to participate in a course on the
QAPACE study during a full week. During this course, each
participant was requested to ask young relatives to test the
questionnaire and to bring their comments back. Future supervisors
were selected from this group. The latter were secondarily
instructed, trained and motivated during a three-day workshop
devoted to the management of the questions on the questionnaire
by the pupils and to the means for minimizing biases in the
questionnaire. The supervisors received specific training
for assisting the children and giving them a proper understanding
of the questions in the questionnaire for minimizing biases.
They were particularly instructed on how to read out loud
and explain the written foreword comment of the questionnaire
about the specific meaning of an average day when answering
the different items.
Three schools were randomly selected from among the 460 schools
of Bogotá not participating in a planned future bigger survey,
urban co-ed regular diurnal schools, with both elementary
and secondary grades, and with a physical educator, one from
each from high, middle and low socio-economic strata, a formal
written acceptance by the parents, students and administrative
staff of the school was requested. The acceptance criteria
were: 1) 8-16 yr old; 2) born and living in Bogotá; 3) healthy,
without disabilities; 4) non pregnant. Six students were randomly
selected in each of the nine age groups (8-16 yr) for each
gender. Hence, a total of 3 x 6 x 9 x 2 = 324 children were
exposed to the initial version.
The students were invited in groups of 10-15 to receive instructions
on how to identify only the activities they had participated
in on at least ten occasions over the last year, and to complete
the questionnaire. For each of those activities they had to
specify the corresponding estimated average duration of each
session in hours and minutes per day and the frequency of
these sessions expressed in days per week. The questionnaires
were collected and checked for inconsistencies. Less than
40 minutes were necessary to complete them.
The
reproducibility
Three schools were selected from among the remaining 457 schools.
Three students were randomly selected for each of the schools,
nine grades and two genders, totalizing 162 students. Out
of the randomly selected sample of 162 children, only 121
were included; 41 were not included due to non compliance
of the criteria. All the 121 subjects filled the same questionnaire
90 days later (McDowell, 1987).
At the time of the surveys, the students were weighed in light
clothing on a calibrated platform (Seca Digital Floor Scales
- Model 7700). Height was measured to the nearest 0.1cm using
a free standing Holtain Anthropometer. All data was stored
in a Visual FoxPro 6.0 database.
Estimation
of the energy expenditure using the questionnaire
The Daily Energy Expenditure (DEE), for school and vacation,
along with the PA compendium (Ainsworth et al., 2000)
were used to obtain the annual mean DEE.

The sum is extended over all possible activities i (i=1
to 13). For each activity i (i=1 to 13), f(i) corresponds
to its daily frequency, d(i) to its mean duration and m(i)
to its intensity according to the compendium. SP corresponds
to School period and VP corresponds to Vacation period.
Validation
methods
The direct and indirect peak VO2 methods were used
on 36 subjects from the reliability study who were randomly
selected and whose results were plotted with the Bland-Altman
method.
The
measurements of oxygen uptake
Indirect
method: aerobic fitness
The peak VO2 was assessed using the Lèger Test.
In compliance with the protocol, the laps were counted. Stage
and level were converted into peak VO2 mL·kg-1·min-1,
using the following formula (Leger and Lambert, 1982):
Peak
VO2 = 31.025+3.238*speed (km·h-1)-3.248*age (y)+0.1536*
speed (km·h-1)* age (y)
Direct
method: ergo-spirometry
The Hebestreit protocol was used (Heberstreit et al., 2000)
on a calibrated cycle ergometer (ER900 Jaeger, Würzburg, Germany).
The work rate was initially set up to 0 W·kg-1 body mass for
2 minutes, and then increased every 2 min by 1 W·kg-1 body
mass. After a total of three 2 min-stages, including the initial
stage, work rate was increased
every min by 0.5 W·kg-1 until exhaustion. The peak oxygen
uptake, expressed in mL·kg-1·min-1, was determined
from expired air sampled at 30 seconds intervals using an
Oxycon Delta Jaeger. The measured outcomes were the averaged
cardiac frequency (CF) over the duration of the experiment
(beats.min-1), the respiratoryquotient (RQ), the
Minute Respiratory Volume (MRV) both at the maximal load,
and the peak VO2. The values of the peak VO2
were secondarily converted into kJ.kg-1.h-1 using 1 Met =
4.184 kJ.kg-1.h-1 =1 kcal= 0.207 L of O2 [Ainsworth
et al., 2000,].
Statistical
analysis
Means and standard deviations were used for both the test-
retest reproducibility between the two periods, and also the
Validity study, using Pearson's ICC with its 95% confidence
interval (SPSS 11.0 statistical Software, Chi, Ill) and the
Bland & Altman plot (Bland et al., 1986).
For validation, two methods were used for, 1) the concordance
between direct and indirect peak VO2, and 2) the
concordance between direct or indirect peak VO2
and the DEE over a one year period.
|
| RESULTS |
|
Study
1: Questionnaire comprehension
Between August 2001 and October 2001 the comprehension study
was undertaken with a sample of the 324 remaining students,
i.e. 162 boys and 162 girls, aged 8-16 years (Table
2).
It was necessary to modify Distance and Mode of Transportation
and Sports, and, "Child care" was added to home
activities, because among girls from low income families,
this activity is common (Table
1).
Study
2: Test re-test study
The study was carried out from February to March 2002. The
time needed for each session was shortened to 30 minutes average
for all age groups. A general description of the study sample
of the 121 is given in Table
2. The ICC of the group sorted by age, grade, gender,
etc. is in Table 3. The
corresponding Bland & Altman DEE plots are shown in Figures
1, 2
and 3. The first one corresponds to the total population.
The lower and upper limits of two standard deviations below
and above the mean difference (8.5
kJ) were -515.5 and 532.5 kJ·24-1 hours. The mean absolute
EE of the two questionnaires was 7566 kJ·d-1 (SD 3521). In
boys (Figure 2), the
mean difference was 10.8 with lower and upper limits of -546.2
and 567.8 kJ·24-1 hours. Whereas in girls (Figure
3), the mean difference was 4.5 with lower and upper limits
of -487.5 and 496.5.
In order to estimate the variability capacity of the DEE according
to the daily activities as recorded by the questionnaire,
the mean durations for each of the thirteen categories of
activities are shown (Table
4).
In Table 4, the categories
1- 3, 9, 11-13 correspond to rather stable activities all
year around, whereas the categories 4-7 and 8 correspond to
stable activities during the school period. In the 7 x 24
hours = 168 hours of a school or vacation week, a mean of
157 (93.5 %) and 145.2 (86.4 %) hours/week, respectively,
correspond to routinely fixed activities, leaving only 6.4%
and 22.8 %, for variability in physical activities during
the periods.
It can be noted that the highest correlation correspond to
the rather fixed activities (Table
4: activities 1-3 and 5-12), whereas the lowest ones correspond
to more variable activities (Distance and mode of Transportation
and Home Activities).
Study
3: Validation study
The mean values of the observed CF, RQ and MRV suggest the
rather good quality of the load reached by the students during
the peak VO2 Test.
The overall mean DEE was 125.7 (SD 24.9) kJ·kg-1·min-1,
whereas it was 135.5 (SD 28.8) (boys) and 115.9 (SD 15.6)
(girls). The mean values of DEE were higher in boys
than in girls, whether they were considered over one year
or separately over the school or vacation periods (Table
5).
The relationship between the direct and indirect measurements
of peak VO2 is shown on Figure
4. The general ICC is 0.91 (p < 0.01), whereas it was
0.96 (boys) and 0.67 (girls).
The ICC between the indirect measurement of VO2
uptake and the overall mean DEE was 0.56 (p < 0.0001).
The corresponding ICC between direct measurement of peak VO2
and the respective mean DEE was 0.69 (p < 0.00001). The
ICC remained high for both school and vacation. They were
lower in the female group as compared with the male group
(Table 6), and increased
with age category. The Bland-Altman plot between the DEE and
the direct and indirect peak VO2 are shown in Figures
5 and 6.
|
| DISCUSSION |
|
The
aim of the present study was to assess the reproducibility
and validity of the QAPACE questionnaire in a random sample
of children attending school in the city of Bogotá, as a preliminary
step for a large-scale study aiming to evaluate PA in the
corresponding population. The 30 min average time needed to
fill the questionnaire doesn't exceed the mental concentration
capacity of youngsters and has showed a high reproducibility,
although the youngest subjects used more time completing the
questionnaire.
Generally, children are unable to estimate accurately the
duration of an activity. For them, intensity and enjoyment
are directly tied to the duration of any activity. To make
things easier for the subjects, especially for the youngest
ones, different specific periods of time (15 min, 30 min,
45 min, 60+ min) were offered, so as to improve the accuracy
while completing the questionnaire [Montoye, 1996).
The questionnaire was designed to measure the mean DEE over
the past year, during school and vacation, 24 hours a day.
We believe that the repeated previous comprehension tests,
the presence of a supervisor, the limited size of the group
with the possibility of answering to their questions could
explain the high reproducibility.
The delay of 6 weeks between the two test-retest sessions
could have been too short to detect changes in activities.
The six weeks detainment between the test-retest was reported
to represent the minimal time for a subject to forget the
previous responses (McDowell, 1987).
The delays in the studies reported in the literature can be
10 days (Vuillemin et al., 2000),
15 days (Booth et al., 2001),
one month (Aaron et al., 1993),
3 months (Aaron et al., 1995;
Berthouze et al., 1993),
6 months (Pols et al., 1997)
or one year (Aaron et al., 1995).
It has been reported that surveys focusing on a one year time
frame are more likely to reflect usual activity patterns than
those recording activities over a few days or over the past
week (Kriska and Caspersen, 1997).
The ICC was lower, in the youngest and oldest groups, which
could correspond to ages with less concentration or unstable
behavior. The ICC were higher in children from higher socio-economic
status and for the categories corresponding to a personal
choice like artistic activities, sport competition and vacation
whereas they were lower for home activities or transportation,
corresponding to mandatory or uncomfortable activities.
Few studies have examined the reproducibility and validity
of a questionnaire in children on the yearly PA using a self-administered
but supervised modality. Thus, direct comparisons with other
studies differing in test instrument, population and time
frame should remain cautious. Nevertheless, the reproducibility
coefficients were comparable to the ones reported with respect
to the different test-retest time intervals. The studies in
children show ICC between 0.66 and 0.98 with time intervals
between 6 days and 1 year (Aaron et al., 1995;
Baecke et al., 1982;
Berthouze et al., 1993;
Bouchard et al., 1983;
Garcia et al., 1997;
Kowalski et al., 1997;
Pols et al., 1997;
Sallis et al., 1993,
Taylor et al., 1978;
Weston et al., 1997).
In adults, the following ICCs were reported as: 0.91 (6-10
days) (Bouchard et al., 1983),
0.89 (1 month) and 0.69 (1 year) (Taylor et al., 1978),
0.89 (1 month) and 0.79 (11 months) (Baecke et al., 1982),
0.997 (7 days) (Berthouze et al., 1993),
0.83 (95% C.I. 0.66- 0.99) (10 days) (Vuillemin et al., 2000).
In a self-administered survey using 1 day PA recall questionnaire
concerning 90 American teenagers from 7th to 8th
grades (mean age 14 years), the ICC was in the range 0.98
to 0.99 using the heart rate method, Caltrac and pedometer
measurements of 0.43, 0.77 and 0.88 (Weston et al., 1997).
When the CAINM questionnaire was applied to a Spanish speaking
population of school children from Mexico City (Hernandez
et al., 2000),
both the children and their mothers were tested six months
apart on the children activities and the results were compared.
The correlation coefficients, adjusted on age, gender and
socio-economic level, ranged between 0.09 and 0.55. This study
dealt mainly with low socio-economic population.
The capacity of extrapolating the results of the reproducibility
study to a large survey relies on the modalities of selection
of the sample of schoolchildren. In the Validity study a significant
correlation between the estimated global DEE and both the
indirect peak VO2 measurement (Leger test) and
the direct peak VO2 measurement were found.
The lower ICC observed in girls could be explained either
by a different body composition between girls and boys with
a higher fat mass in the former and a higher lean mass in
the latter. This difference in mass conveys that the subjects
with higher lean mass present a greater capacity for effort
expressed in peak VO2 and strength, and a lower
motivation for physical activity in teenage girls (Aaron et
al., 1993,
Cooper, 1996).
The measurements of peak VO2 were lower in girls,
by 23% in direct measurements and 17% in indirect measurements,
all differences previously reported in the literature (Flandrois
et al., 1982;
MacMurray et al., 1998;
Turley et al., 1997).
The global intra-class correlation coefficients (ICC) for
the global measurements of PA showed a high ICC r = 0.96 (95%
CI 0.95-0.97). The few studies which have been published addressing,
specifically the validity of a self-administered but supervised
questionnaire, aimed to estimate a mean PA index in children
over the past year; therefore, direct comparisons with other
studies differing in test instruments, the population studied,
the time frame and the geographical location should remain
cautious.
However, the ICC reported here appears comparable to the ICC
of the Bouchard three day- questionnaire with PWC 150 or PWC
50/kg of respectively 0.70 and 0.27 (Bouchard et al., 1983)
for a recalled period covering the last six to ten days; They
are also comparable to the values of the ICC reported in other
studies: 0.47 - 0.82 in a seven day recall questionnaire with
the heart rate as the biological measurement (Sallis et al.,
1993);
0.40 in children 4- 8 years, with the Estonian Questionnaire
of the parents and their children and the heart rate (Harro,
1997);
0.38 for 7-9 years gymnasts; 0.42 for recreational in prepubertal
girls with a 7 day- delay questionnaire and the Caltrac accelerometer
in Scerpella et al., 2002.
Also for a seven day recall questionnaire adapted to children
with max VO2 as the biological measurement in Schmucker
(Schmucker et al., 1985)
the ICC was 0.67; 0.40 for boys and 0.23 for girls using a
seven day recall questionnaire adapted to children and submaximal
VO2 in cycle ergometer as the biological measurement
in Suter (1993).
The correlations between the direct and indirect measurements
of peak VO2 were similar to the values reported
by McNaughton. (r = 0.87) (McNaughton et al., 1996)
or Van Mechelen (r = 0.76) (Van Mechelen et al., 1986).
|
|
| CONCLUSION |
| To our knowledge, no study has directly addressed the issue of
estimating a yearly average PA including school and vacation periods.
The majority of available data on the validity of PA questionnaires
in children concerned short-term (one, three, seven days) or mid-term
(months) recall of physical activities. The QAPACE questionnaire is
valid for assessing the routine PA patterns of children and adolescents
in the tested sample. As it was randomly selected through a two step
procedure in the population of schoolchildren of Bogotá, the QAPACE
questionnaire proved its reliability and accuracy for epidemiological
study and the possibility to be used in large population studies. |
| ACKNOWLEDGMENTS |
| The authors thank all those who participated in the study, Oded
Bar-Or; Laurence Joubin, Colette Moreel, Necker Hospital, Paris; Diana
Gavassa, José Chaar, Germán Garcia; Efrain Patiño, Jesús Reyes and
Edgar Rodriguez; Alirio Rodriguez, from El Bosque University; Secretaría
de Educación de Bogotá and Aide au Développement de la Médecine du
Sport, France. |
| KEY
POINTS |
- The presence of a supervisor, the limited size of the group with
the possibility of answering to their questions could explain
the high reproducibility for this questionnaire.
- No study in the literature had directly addressed the issue of
estimating a yearly average PA including school and vacation period.
- A two step procedure, in the population of schoolchildren of Bogotá,
gives confidence in the use of the QAPACE questionnaire in a large
epidemiological survey in related populations.
|
| AUTHORS
BIOGRAPHY |
Nicolas BARBOSA
Employment: Sports Medicine Program, School of Medicine,
El Bosque University, Bogotá, Colombia.
Degree: MD.
Research interests: Physical activity, ergospirometry,
and sports medicine.
E-mail: nibarbosa@hotmail.com |
|
Carlos
E. SANCHEZ
Employment: Sports Medicine Program, School of Medicine,
El Bosque University, Bogotá, Colombia.
Degree: MD.
Research interests: Sports medicine epidemiology and
kinanthropometry.
E-mail: carlosefrain@cable.net.co |
|
Jose
A. VERA
Employment: Sports Medicine Program, School of Medicine,
El Bosque University, Bogotá, Colombia.
Degree: MD.
Research interests: Physical fitness tests.
E-mail: joanvefe29@hotmail.com
|
|
Wilson
PEREZ
Employment: Sports Medicine Program, School of Medicine,
El Bosque University, Bogotá, Colombia.
Degree: MD.
Research interests: Ergospirometry.
E-mail: wilanpevi@latinmail.com
|
|
Jean-christophe
THALABARD
Employment: APHP & UMR CNRS MAP5, University Paris Descartes,
45, rue des Saints Peres, 75006 Paris, France.
Degree: MD, PhD.
Research interests: Endocrinology and metabolism, Epidemiology.
E-mail: jean-christophe.thalabard@htd.aphp.fr
|
|
Michel
RIEU
Employment: Physiology Laboratory of Adaptations, Medicine
Faculty, Cochin Port Royal, René Descartes University -V, 15,
rue de l´Ecole de Médicine 75270 Paris, France.
Degree: MD, PhD.
Research interests: Exercise physiology.
E-mail: rieu.michel@wanadoo.fr |
|
|
|
|