Examining the Validity of the LexTALE Test for Japanese College Students

The question of how vocabulary knowledge of second language (L2) learners can be measured in a valid and reliable way has attracted attention from researchers. One widely used format for assessing vocabulary knowledge is a Yes/No test, where learners are asked to indicate whether they know each vocabulary word on the test. The purpose of this study was to examine whether the LexTALE test, a recently developed Yes/No English vocabulary test, can be an approximate measure of vocabulary knowledge and general proficiency for Japanese learners of English. In this study, 111 Japanese university students majoring in English took the LexTALE, an English to Japanese translation test, and the Vocabulary Size Test (VST). They were further asked to provide self-ratings of their English proficiency. Analysis showed that the LexTALE score correlated more strongly with the translation score and VST score than self-ratings of their proficiency. The results also showed that the LexTALE score correlated significantly with the TOEFL ITP® score, although some self-ratings resulted in a higher correlation. The findings suggest that for Japanese learners of English, LexTALE may be used as an approximate measure of English vocabulary knowledge and, to a lesser extent, general proficiency.

Nakata, T., Tamura, Y., & Aubrey, S. (2020). Examining the validity of the LexTALE test for Japanese college students. The Journal of Asia TEFL, 17, 335–348. doi.org/10.18823/asiatefl.2020.17.2.2.335

SCImago Journal & Country Rank

Kobayashi et al. (2019)

この研究では,スピーキングタスク中の自己修正(self-correction)行動中に学習者の注意がどの側面に向いているのか,そしてそれはタスクの認知的な負荷の影響を受けるのかという点を調査しました。認知的負荷の高低を操作した2種類の地図タスクを用意し,学習者はその課題に取り組んだあとに刺激再生法によるインタビューを受けました。インタビューのコメントを概念化,語彙選択,文法化,音声化の4つのカテゴリに分類し,自己修正中の認知プロセスを分析しました。その結果,負荷の高いタスク中には文法化よりも概念化を行う頻度がより高かったのに対し,負荷の低いタスクではそのような違いが見られなかったことが明らかになりました。また,熟達度の高低によって概念化の頻度に差は見られなかったものの,熟達度の高い学習者は語彙よりも文法面により注意を向けることができることが示唆されました。

Kobayashi, M., Iwatani, M., Tamura, Y., & Abe, D. (2019). Cognitive processes during self correction in L2 oral production: Comparison between tasks with a high and a low cognitive demand. LET Journal of Central Japan, 30, 31–44

Cognitive processes during self correction in L2 oral production: Comparison between tasks with a high and a low cognitive demand

This study investigated how task difficulty affects cognitive processes during self correction in L2 English oral production. Previous studies have explored this issue based on the taxonomy of self correction behavior proposed by Kormos (1999) which classifies self corrections into different-information repair, appropriacy repair, and error repair. This study sought to determine whether learners focus more on concept, lexis, grammar, or phonology when self corrections occur. English learners were given two direction-giving map tasks: one which is cognitively more demanding in generating message (Task High), and the other cognitively less demanding (Task Low). Each task was followed by a stimulated recall interview to determine the learner’s cognitive processes when a self correction was observed. Their comments were categorized into four cognitive stages: conceptualization, lexical encoding, grammatical encoding, and phonological encoding. We hypothesized that Task High would induce more conceptualization than Task Low. The participants focused on the conceptual aspect more frequently than the grammatical aspect during Task High, while no difference in cognitive process was found in Task Low. The results also revealed that, while there was no significant difference in conceptualization between high-proficient and low-proficient learners, the more proficient learners tended to focus more on grammatical aspects than lexical.

Kobayashi, M., Iwatani, M., Tamura, Y., & Abe, D. (2019). Cognitive processes during self correction in L2 oral production: Comparison between tasks with a high and a low cognitive demand. LET Journal of Central Japan, 30, 31–44.

Fukuta et al. (2019)

この研究は,第二言語のライティングにおけるランゲージングの効果を検証したものです。従来の研究では,修正時のプロダクトに対してランゲージングの影響を見るものが多かったですが,今回は新しいプロダクトを書く際にどのような変化が見られるかを観察しました。ランゲージングのみを行う群と,間接的フィードバック(誤りが’含まれる箇所に下線を引く)を受ける群に分かれ,3段階のライティング課題に取り組みました。結果として,フィードバックを受けたグループは文法面に対してランゲージングのみの群よりも多くの修正を行っていたのに対して,最終的に新しくライティング課題に取り組む際には修正時に見られた文法への注意の影響はなくなっていました。つまり,フィードバックを受けることによってもたらされたメタ言語的な修正が必ずしもライティングの質を向上させるわけではなく,ランゲージング行為そのものがライティングの質に影響を与えているということが示唆されました。

Fukuta, J., Tamura, Y., & Kawaguchi, Y. (2019). Written languaging with indirect feedback in writing revision: Is feedback always effective? Language Awareness, 28, 1–14.  doi:10.1080/09658416.2019.1567742

SCImago Journal & Country Rank

Tamura et al. (2019)

本研究では,while the king and the queen kissed/left the baby read the book in the bedのようなガーデンパス文を用いて数の処理の問題を検証しました。相互作用動詞(e.g., kiss)の意味上の主語が複数であると解釈されれば,動詞直後の名詞句が自動的に主節の主語であると解釈されるため,ガーデンパス効果は発生しません。この現象が英語母語話者のみならず日本語を第一言語とする英語学習者にも見られるということを明らかにしたのがこの研究です。この結果は,A and Bという名詞句を概念的に複数として表象していることを示しており,この点においては第二言語学習者も英語母語話者と同様の処理が可能であると言えます。

Tamura, Y., Fukuta, J., Nishimura, Y., Harada, Y., Hara, K., & Kato, D. (2019). Japanese EFL learners’ sentence processing of conceptual plurality: An analysis focusing on reciprocal verbs. Applied Psycholinguistics, 41, 59–91. doi:10.1017/S0142716418000450 [Author Manuscript] [Read Online]

SCImago Journal & Country Rank

Nishimura et al. (2018)

NICT-JLEコーパスから得られたデータを用いて,第二言語学習者の口頭産出パフォーマンスをネットワーク分析という手法で記述した論文です。これまでは,学習者のパフォーマンスは言語データから算出される様々な指標を正確さ,複雑さ,流暢さなどの観点から分析することが試みられてきましたが,これらの指標の関係性は学習者の能力に依存して変化する複雑な系をなすと考えられます。そこで,複雑系理論に基づくネットワーク分析を行い,上位群と下位群ではネットワークにおける中心性の指標が異なることや,指標間の関係性も異なることなどを示しました。これらの結果は,一意的に変数を取り上げてその指標の関係性や変化を議論する危険性を示唆しており,ネットワーク分析という手法がこの点で有用性があることも示していると考えられます。

Nishimura, Y., Tamura, Y., & Fukuta, J. (2018). Network structures in L2 oral performance: A learner corpus study. Annual Review of English Language Education in Japan, 29, 113–128. [Full Article]

Written languaging with indirect feedback in writing revision: is feedback always effective?

Recent studies have shown that languaging contributes to second language skill development. Feedback is often used in combination with languaging as a prompt of verbalization during writing revision, and this combination has shown the effect of increasing the quality of writing. The present study tested whether and how indirect feedback helps learners engage in languaging, and whether the effects continued with the second new writing on the same topic. Forty participants engaged in a three-stage writing task: writing a first draft, revision with languaging with/without feedback on specific grammatical or lexical errors, and writing the second draft. Writing was multidimensionally assessed in terms of syntactic complexity, grammatical accuracy, and fluency. The results showed that the participants focused more on grammar when they were given feedback and succeeded in more error correction than when they did not receive feedback. Learners improved in fluency and slightly in accuracy, but not in complexity, regardless of the existence of indirect feedback. Importantly, written languaging with feedback did not show superiority to written languaging without feedback in skill development. The findings suggest that even metalinguistic correction induced by feedback is not always necessarily effective, but languaging may have a positive effect on overall writing quality.

Fukuta, J., Tamura, Y., & Kawaguchi, Y. (2019) Written languaging with indirect feedback in writing revision: is feedback always effective?, Language Awareness, 28, 1–14. DOI: 10.1080/09658416.2019.1567742

If you would like to download a free copy of this article, please use the following link:

https://www.tandfonline.com/eprint/ix3sX3eyhmZtAZxEbfm6/full?target=10.1080/09658416.2019.1567742

SCImago Journal & Country Rank

Japanese EFL Learners’ Sentence Processing of Conceptual Plurality: An Analysis focusing on reciprocal verbs

This study aimed to investigate how Japanese EFL learners, whose first language does not have obligatory morphological number marking, process conceptual plurality. The targeted structure was reciprocal verbs, which require conceptual plurality to interpret their meanings correctly. The results of a sentence completion task (SCT) confirmed that participants could use reciprocal verbs reciprocally in English. In a self-paced reading experiment, participants read sentences with reciprocal verbs and those with optionally transitive verbs (e.g., while the king and the queen kissed/left the baby read the book in the bed). There was no reading time delay for reciprocal verbs but a delay for optionally transitive verbs. Therefore, the participants succeeded in processing L2 conceptual plurality in the online sentence comprehension task.

Tamura, Y., Fukuta, J., Nishimura, Y., Harada, Y., Hara, K., & Kato, D. (2019). Japanese EFL learners’ sentence processing of conceptual plurality: An analysis focusing on reciprocal verbs. Applied Psycholinguistics, 40, 59–91. doi:10.1017/S0142716418000450 [Author Manuscript]

SCImago Journal & Country Rank

Network Structures in L2 Oral Performanc: A Learner Corpus Study

Complexity, accuracy, and fluency as dimensions of L2 performance, proficiency, and development have been measured through a small number of measures that researchers arbitrarily choose. L2 performance is never a simplistic structure that can be captured through the reduction of one or two elements. Reductionism practice has overlooked perspectives of how each measure interacts and changes. The current study attempts to describe dynamic relations between various linguistic features, investigate how each element is intertwined, and explore which linguistic features play a central role in L2 oral performance, based on the complexity theory using network analysis. Spoken data were drawn from the NICT JLT Corpus, which comprises English transcriptions uttered by Japanese learners, and were attached their individual proficiency. Two networks of each proficiency group (i.e., low and high) were delineated, and centrality measures were calculated. The results reveal that the network structures in L2 oral performance change to be dependent on the learner’s proficiency. Furthermore, linguistic features that play a central role in the network structure also change with learner’s proficiency. These results are highly suggestive toward L2 oral performance and the relationship among various linguistic features. The significance of the network analysis is also discussed.

Nishimura, Y., Tamura, Y., & Fukuta, J. (2018). Network structures in L2 oral performance: A learner corpus study. Annual Review of English Language Education in Japan, 29, 113–128. [Full Article]

Analysis of oral communication-oriented activities in junior high school textbooks: Focusing on task criteria proposed by second language research

In the field of language teaching research, the importance of meaningful interactions and oral communication activities have been pointed out repeatedly. In English language teaching in Japan, this importance has also been recognized by some teachers, although gradually. In this study we analyzed 3 textbooks used in Japanese junior high schools, referring to task criteria (e.g., Ellis, 2003; Ellis & Shintani, 2014) that were developed for the purpose of promoting authentic meaningful communication. There were 4 task criteria: (a) the focus is on meaning, (b) there is a gap, (c) the learners rely on their own linguistic or nonlinguistic resources, and (d) learners’ language use is not used to assess achievement. We examined whether or not the oral-communication-oriented activities in the textbooks met these criteria. The textbook analysis indicated that the majority of the activities presented did not meet the task criteria. Among the four criteria, (c)—the learners rely on their own resources—was met the least. In most of the cases, linguistic resources such as conversation examples and lexical items were provided for the students, and the only thing the students needed to do was to use those resources. On the other hand, almost half of the activities met (b)—there is a gap—and this was the most easily satisfied criterion. We gave careful consideration to what kind of learner language proficiency development can be expected if classroom teachers use these communication-oriented activities as they appear in the textbook. In doing so, we considered the results obtained from previous SLA research. The fact that most of the activities in the textbooks did not meet the task criteria means that, if they are not modified appropriately, they would prevent language learners from engaging in voluntary grammatical encoding and negotiation of meaning. For example, as most of the activities did not meet criteria (c), the students can hardly experience grammatical encoding because they do not need to think about what linguistic form they should use to convey the meaning. Also, the fact that the focus of the task was not on meaning would result in a serious lack of meaningful negotiation, and therefore the students would miss precious opportunities to get comprehensible input through negotiation of meaning. In sum, the activities presented in the textbooks we analyzed were not enough to guarantee that the students would participate in negotiation of meaning and experience necessary cognitive processing during speaking, both of which are the essence of SLA. We do not propose that the activities should not be used or that they are useless. Rather, we believe that it is worthwhile to think of the communication-oriented activities with task criteria in mind in order to ensure the development of learners’ language proficiency. In addition, teachers should modify the activities to enable the students to focus on meaning and to communicate using their own resources. The results of this study provide useful insights for teachers who want to make their classes more communicative and to have the students engage in meaningful conversation.

Fukuta, J., Tamura, Y., & Kurita, A. (2017). Analysis of oral communication-oriented activities in junior high school textbooks: Focusing on task criteria proposed by second language research. JALT Journal, 36, 165182 [Full Article]