- 作者: 林妙香; 鄭湧涇; 毛松霖; 郭鴻銘; 方泰山; 林政宏; 林金盾
- 作者服務機構: 中央研究院統計科學研究所; 國立台灣師範大學理學院
- 中文摘要:
本文針對科學學習進展指標(ILPS)編製過程的雙重考量,而提出四種相關的統計方法,分別檢視ILPS測驗
試題認知複雜度結構、試題同質性、群簇性及單維性。以Quasi-Simplex model檢視生物ILPS測驗之四個分測
驗(subtests)的複雜度階層,研究結果顯示國中生物甲卷測驗試題複雜度具有知曉<了解<應用<統整之階層順
序,而國小甲卷則具有知曉<了解<統整<應用之階層順序。雖然研究結果亦顯示應用及統整分測驗複雜係數之
差距不顯著,但整體試卷可視為不只測試記憶的反芻。此外,研究結果亦顯示:學科專家判斷試題的知曉及了
解認知層次的客觀性高於判斷試題之應用及統整層。
10份ILPS測驗之各份試題依主成份因素分析之傳統參照標準(a F ?0.30)所保留的試題,經群簇分析所得
的樹狀圖無明顯的群簇出現,顯示試題滿足同質性的特徵。在此參照標準下,(1)10份ILPS測驗皆滿足Reckase
之單維指標,因各份試題之第一主成份因素特徵值皆佔總變異量之20%以上;(2)但其中有三份測驗較不符合
Lord之單維指標,因第二主成份因素之特徵值較顯著性地大於其後餘因素之特徵值;(3)依據Stout的單維定義
及考驗,除國中生物及物理ILPS測驗以外,其餘8份測驗試題皆滿足單維假設;(4)此二份ILPS測驗,以
a F ?0.40所保留的試題,則亦滿足單維假設。
依據分析結果,本研究建議編製及分析ILPS之程序及配合要點,以期符合指標內涵及合理應用IRT模式
o - 英文摘要: Employing statistical methods such as the Quasi-Simplex model, principal component analysis,cluster analysis, and Stout's nonparametric unidimensionality test, we investigated the complexitystructure and dimensionality of ILPS test items seeking to measure student performance in six sciencesubject areas. It was found that the four biology subtests for Grades 6 and 9 (all of which contained items designedto measure the cognitive processes involved in knowledge, understanding, application, and integration)fit the Quasi-Simplex model;however, the observed hierarchical order of complexity for the four Grade6 subtests differed from the original hypothesis. The results imply:(1)both biology tests are capableof measuring more than simple factual knowledge, and (2) it is more difficult for test writers to createitems which accurately measure application and integration abilities than items which measure simpleknowledge and understanding. Use of the single linkage method failed to find consistent patterns of distinct clusters in dendrogramsassociated with the ten ILPS tests, meaning that items within each ILPS test set maintained a homogenousstructure. Results from Stout's procedure revealed that the Grade 9 biology and physics tests failedto support the null hypothesis of essential unidimensionality. The deletion of all items with a first factorloading of less than 0.40 from these two tests resulted in the 10 ILPS tests becoming essentiallyunidimensional.
- 中文關鍵字: --
- 英文關鍵字: --