Questões

What is Validity?
by Evelina Galaczi
July 17th, 2020

The fundamental concept to keep in mind when creating any assessment is validity. Validity refers to whether a test measures what it aims to measure. For example, a valid driving test should include a practical driving component and not just a theoretical test of the rules of driving. A valid language test for university entry, for example, should include tasks that are representative of at least some aspects of what actually happens in university settings, such as listening to lectures, giving presentations, engaging in tutorials, writing essays, and reading texts.

Validity has different elements, which we are now going to look at in turn.

Test Purpose – Why am I testing?

We can never really say that a test is valid or not valid. Instead, we can say that a test is valid for a particular purpose. There are several reasons why you might want to test your students. You could be trying to check their learning at the end of a unit, or trying to understand what they know and don't know. Or, you might want to use a test to place learners into groups based on their ability, or to provide test takers with a certificate of language proficiency. Each of these different reasons for testing represents a different test purpose.

The purpose of the test determines the type of test you're going to produce, which in turn affects the kinds of tasks you're going to choose, the number of test items, the length of the test, and so on. For example, a test certifying that doctors can practise in an English-speaking country would be different from a placement test which aims to place those doctors into language courses.

Test Takers – Who am I testing?

It’s also vital to keep in mind who is taking your test. Is it primary school children or teenagers or adults? Or is it airline pilots or doctors or engineers? This is an important question because the test has to be appropriate for the test takers it is aimed for. If your test takers are primary school children, for instance, you might want to give them more interactive tasks or games to test their language ability. If you are testing listening skills, for example, you might want to use role plays for doctors, but lectures or monologues with university students.

Test Construct – What am I testing?

Another key point is to consider what you want to test. Before designing a test, you need to identify the ability or skill that the test is designed to measure – in technical terms, the ‘test construct’. Some examples of constructs are: intelligence, personality, anxiety, English language ability, pronunciation. To take language assessment as an example, the test construct could be communicative language ability, or speaking ability, or perhaps even a construct as specific as pronunciation. The challenge is to define the construct and find ways to elicit it and measure it; for example, if we are testing the construct of fluency, we might consider features such as rate of speech, number of pauses/ hesitations and the extent to which any pauses/hesitations cause strain for a listener.

Test Tasks – How am I testing?

Once you’ve defined what you want to test, you need to decide how you’re going to test it. The focus here is on selecting the right test tasks for the ability (i.e. construct) you're interested in testing. All task types have advantages and limitations and so it’s important to use a range of tasks in order to minimize their individual limitations and optimize the measurement of the ability you’re interested in. The tasks in a test are like a menu of options that are available to choose from, and you must be sure to choose the right task or the right range of tasks for the ability you're trying to measure. 

Test Reliability - How am I scoring?

Next it’s important to consider how to score your test. A test needs to be reliable and to produce accurate scores. So, you’ll need to make sure that the scores from a test reflect a learner's actual ability. In deciding how to score a test, you’ll need to consider whether the answers are going to be scored as correct or incorrect (this might be the case for multiple–choice tasks, for example) or whether you might use a range of marks and give partial credit, as for example, in reading or listening comprehension questions. In speaking and writing, you’ll also have to decide what criteria to use (for example, grammar, vocabulary, pronunciation, essay, organisation in writing, and so on). You’ll also need to make sure that the teachers involved in speaking or writing assessment have received some training, so that they are marking to (more or less) the same standard.

Test Impact - How will my test help learners?

The final – and in many ways most important – question to ask yourself is how the test is benefitting learners. Good tests engage learners in situations similar to ones that they might face outside the classroom (i.e. authentic tasks), or which provide useful feedback or help their language development by focusing on all four skills (reading, listening, writing, speaking). For example, if a test has a speaking component, this will encourage speaking practice in the classroom. And if that speaking test includes both language production (e.g. describe a picture) and interaction (e.g. discuss a topic with another student), then preparing for the test encourages the use of a wide range of speaking activities in the classroom and enhances learning.

Adapted from: https://www.cambridgeenglish.org/blog/what-is-validity. Acesso em: 15 dez. 2023.

The Rise of the “Bike Bus” Movement

01 On Earth Day* 2022, Sam Balto, a physical education teacher in Portland, convinced a few

02 dozen parents to send their kids to school on their bikes and posted the first in a series of videos

03 that turned his “bike bus” into a viral sensation. Balto has continued documenting his weekly

04 bike buses with joyous videos that show students rolling to school while he blasts music from an

05 eclectic collection of artists, including AC/DC, Metallica, and OneRepublic. Over time, these

06 boisterous bike buses have grown to more than 150 kids. “The more these kids practice riding

07 bikes, the more confident they become. And now they want to keep riding on non-bike bus days,

08 and even on rainy days!” said Balto.

09 Balto’s bike bus is much more than a fad. His TikTok and Twitter videos have raked in

10 millions of views, inspiring similar initiatives in New York, New Jersey, Florida, Utah, Ohio, and

11 Texas. Bike buses previously existed in European cities such as Barcelona and London, but new

12 ones in cities like Cape Town are now joining the trend. Nancy Pullen-Seufert, the director of the

13 National Center for Safe Routes to School, said biking and walking to school have myriad benefits,

14 including “improving air quality, improving safety for walkers and bicyclists, increasing physical

15 activity, and making it easier for school buses and others who can’t actively travel to school to

16 arrive to school on time.”

17 Balto has also triggered real political change by working with lawmakers to pass a so-called

18 “Bike Bus Bill”, that was signed into law by Oregon Governor Tina Kotek in August. “The bill

19 brings flexibility so school districts can now use student transportation funds, which were

20 previously only for school buses, to pay for crossing guards or adults to lead walking school buses

21 or bike buses. It’s awesome.” Balto said. And he is not the only bike bus leader driving positive

22 change in Oregon… Last year, Megan Ramey, who has been organizing a bike bus ___ 2020, was

23 named the Safe Routes to School Manager at Hood River County School District and since then,

24 she has secured nearly $11 million in funding to make it safer for kids to walk and bike to school.

25 “I feel like I'm in a cash-grabbing machine. We just got $7 million to create an off-road trail to

26 the high school. This means kids will be able to bike to high school on a green trail instead of a

27 car-centered road,” said Ramey.

28 Nearly 90% of kids walked to school in 1969. Half a century later, in 2017, that number

29 had fallen to just 10%. That year, a third of students took the school bus and more than half

30 were driven in a private vehicle. This has led to more pollution, with researchers finding that

31 toxic car fumes have an adverse effect on attention, reasoning, and academic performance

32 among school children. In New York, the Open Schools Program has helped increase biking and

33 walking in the 65 schools that restricted traffic during drop-off and pick-up times this year, said

34 Sabina Sethi Unni, who works at Open Plans, a non-profit that supports the shift to walkable

35 cities. “This program makes kids more comfortable with walking and biking at a young age. When

36 they get older, they will be cyclists instead of car users,” said Unni.

(Available in: https://www.distilled.earth/p/the-rise-of-the-bike-bus-movement – text especially adapted for this test).

*Earth Day: a day in April designated for promoting concern for the environment (Merriam-Webster).

Now, for answeri question, consider Text 02. Remember, there is only one answer

Text 02 

“This glocalization in English teaching and learning, which is to do with post-methods, can influence or be practiced in many aspects, especially in interlanguage and culture, individual differences, and learning strategies. This paper reviews and highlights that post-method condition is related to glocalization in English language teaching and learning practices in terms of interlanguage and culture, individual differences, and learning strategies. It also puts forward some research questions for further studies, which may lead the researchers to obtain more information for promoting glocalization to enhance English language teaching."

(Source: Jessica Dwi Lusianov. Post-method Era and Glocalization in Language Teaching and Learning). Available at https://www.atlantis-press.com/proceedings/icollite-20/125949311, accessed on Otober 01st. 2022).