Yıl 2014, Cilt 3, Sayı 2, Sayfalar 213 - 232 2014-01-06

Öğretmen Adayları İçin Aile Katılımına Yönelik Tutum Ölçeğinin Geliştirilmesi: Geçerlik ve Güvenirlik Çalışması

Çiğdem YAVUZ GÜLER [1]

285 440

Bartin University Journal of Faculty of Education (BUJFED) is a international refereed journal that is published two times a year. The responsibility lies with the authors of papers
Bu çalışmanın temel amacı öğretmen adaylarının aile katılımına yönelik tutumlarını ölçmek amacıyla bir ölçme aracı geliştirmek ve bu ölçeğin geçerlik ve güvenirliğini ortaya koymaktır. Bu amaçla oluşturulan 36 maddelik deneysel form 298 öğretmen adayına uygulanmıştır. Açımlayıcı ve doğrulayıcı faktör analizlerinden sonra ölçek, İşbirliğini destekleyici tutumlar (15 madde) ve İşbirliğini engelleyici tutumlar (10 madde), alt ölçeklerinden toplamda 25 maddeden oluşan iki faktörlü bir yapı göstermektedir. Bu iki faktörün birlikte açıkladıkları toplam varyans 43.62’dir. Doğrulayıcı faktör analizi sonuçları; öğretmen adayı örnekleminde kurulan modelin veriyle yeterli bir uyum gösterdiği (χ²=619.86; sd=274, p.01; χ²/sd=2.26; SRMR=0.057; RMSEA=0.065; CFI=0.90; IFI=0.90), bu nedenle ölçeğin yapısal geçerliğe sahip olduğunu göstermektedir. Aile Katılımına Yönelik Tutum Ölçeği’nin toplam puan üzerinden iç tutarlık katsayısı ise .92 olarak bulunmuştur. Bu bulgulardan yola çıkarak ölçeğin, öğretmen adaylarının aile katılımına yönelik tutumlarını belirlemede geçerli ve güvenilir bir ölçek olduğu sonucuna varılmıştır.
Aile Katılımı, Öğretmen adayı, Tutum, Ölçek Geliştirme, Geçerlik, Güvenirlik
  • Abbak, B.S. (2008). Okulöncesi Eğitim Programındaki Aile Katılımı Etkinliklerinin Anasınıfı Öğretmenleri ve Veli Görüşleri Açısından İncelenmesi. (Yüksek Lisans Tezi). Çukurova üniversitesi, Adana.
  • Abdullah, A. K., Seedee, R., Alzaidiyeen, N. J. , Al-Shabatat, A., Alzeydeen, H. K., & Al-Awabdeh (2011). An Investigation Of Teachers’ Attitudes Towards Parental Involvement. Educational Research, 2 (8), 1402-1408.
  • Addi-Raccah, A., & Ainhoren, R. (2009). School Governance and Teachers’ Attitudes to Parents’ Involvement in Schools. Teaching & Teacher Education, 25, 805-813.
  • Akaya, M. (2007). Öğretmenlerin ve Velilerin Okulöncesi Kurumlarında Uygulanan Aile Katılımı Çalışmalarına İlişkin Görüşleri. (Yüksek Lisans Tezi). Anadolu Üniversitesi, Eskişehir.
  • Arsenault, J. E. (1991). A Comparative Study of Teachers’ Attitudes Toward Parent Involvement in The Schools. (Doctoral dissertation). The University of Massachusetts, Amherst. Available from ProQuest Dissertations and Theses database. (UMI No.9132812)
  • Arvizu, S. F. (1996). Family, Community, and School Collaboration. In J. Sikula (Ed.), Handbook of Research on Teacher Education (s. 814-819), New York: Simon & Schuster Macmillan.
  • Asher, C. (1988). Improving The School-Home Connection of Poor and Minority Students. The Urban Review. 20 (1), 109-123.
  • Barnett, M.F. (1997). The Effects of Instruction on Undergraduate Preservice Teachers' Attitudes, Knowledge, and Use of Parent Involvement Strategies.(Doctoral dissertation). State University of New York, New York. Available from ProQuest Dissertations and Theses database. (UMI No.9716397)
  • Bauch, J. P. (1988). Is Parent Involvement Different in Private Schools?. Educational Horizons. 66 (2), 78-82.
  • Baum, A.C.; McMurray-Schwarz, P. (2004). PreserviceTeachers’ Beliefs About Family Involvement: Implications for Teacher Education. Early Childhood Education Journal. 32 (1), 57-61.
  • Becher, R. (1986). Parent Involvement: A Review of Research and Principles of Successful Practice. In L. Katz (Ed.), Current Topics in Early Childhood Education (s: 85-122). Norwood, NJ: Ablex.
  • Becker, H. J.; Epstein, J. L. (1983). Teacher Practices and Parent Involvement. The Education Digest. 46-49.
  • Blasi, M. W. (2002). An Asset Model: Preparing Preservice Teachers to Work with Children and Families “Of Promise”. Journal of Research in Childhood Education. 17(1), 106-122.
  • Bruckman, M., & Blanton, P. (2003). Welfare-to-work Single Mothers’ Perspectives on Parent Involvement in Head Start: Implications for Parent-Teacher Collaboration. Early Childhood Education Journal. 30 (3), 145–150.
  • Burton, C.B. (1992). Defining Family-Centered Early Education: Beliefs of Public School, Child Care, and Head Start teachers. Early Education and Development, 3 (1), 45-59.
  • Büyüköztürk, Ş. (2004) Sosyal Bilimler için Veri Analizi El Kitabı. 4. Baskı. Pegem A Yayıncılık, Ankara.
  • Chavkin, N. F. (1991). Uniting Families and Schools: Social Workers Helping Teachers Through Inservice Training. School Social Work Journal. 15 (1), 1-10.
  • Chavkin, N.F., & Williams, D. (1993). Minority parents and The Elementary School: Attitudes and Practices. In N. Chavkin (Ed.), Families and Schools in a Pluralistic Society (s. 73-83). Albany: State University of New York Press.
  • Chen, M., & Fan, X. (2001). Parental Involvement and Students’ Academic Achievement: A Meta-Analysis. Educational Psychology Review, 13, 1-22.
  • Coleman, J.S. (1991). Parental Involvement in Education. Washington, DC: Government Printing Office.
  • Comer, J.P., & Haynes, N.M. (1992). Summary of School Development Program Effects. New Haven, CT: Yale Child Study Center.
  • Dauber, S., & Epstein, J. (1993). Parents' Attitudes and Practices of Involvement in İnner-City Elementary Schools and Middle Schools. In N. Chavkin (Ed.), Families and Schools in a Pluralistic Society (s. 53-71). Albany: State University of New York Press.
  • Davies, D. (1988). Benefits and Barriers To Parent Involvement. Community Education Research Digest. 1(1), 11-1.9
  • Denessen, E. Bakker, J.; Kloppenburg, L.; Kerkhof, M. (2009). Teacher - Parent Partnerships: Preservice Teacher Competences and Attitudes During Teacher Training in The Netherlands. International Journal about Parents in Education. 3(1), 29-36.
  • Dor, A. ve Rucker-Naidu, T.B., (2012). Teacher Attitudes Toward Parents’ Involvement in School: Comparing Teachers in the USA and Israel. Issues In Educational Research. 22 (3), 246-262.
  • Eagle, E. (1989). Socioeconomic Status, Family Structure, and Parental Involvement: The Correlates of Achievement. Paper presented at the Annual Meeting of the American Educational Research Association, San Francisco. (ED307332).
  • Epstein, J. L. (1995). School, Family, Community Partnerships: Caring for the Children We Share. Phi Delta Kappan. 76 (9), 701-712.
  • Epstein, J. L. (1988). How Do We Improve Programs for Parent Involvement? Educational Horizons. 66 (2), 58-59.
  • Epstein, J. L. (1983). Effects on Parents of Teachers' Practices in Parent Involvement. Baltimore: Center of Families, Communities, Schools and Children Learning, Johns Hopkins University.
  • Epstein, J. L.,&Becker, H. J. (1982). Teacher Practices of Parent Involvement: Problems and Possibilities. Elementary School Journal. 83, 103-113.
  • Epstein, J. L. Connors, L.; Salinas, K. (1993). High School and Family Partnerships Survey and Summaries. Baltimore: Center of Families, Communities, Schools and Children Learning, Johns Hopkins University.
  • Epstein, J.L., & Dauber, S.L. (1991). School Programs and Teacher Practices of Parent Involvement in İnner-City Elementary and Middle Schools. The Elementary School Journal, 91(3), 289-305.
  • Epstein, J. L., & Van Voorhis, F. L. (2001). More than minutes: Teachers’ Roles in Designing Homework. Educational Psychologist, 36 (3), 181-193.
  • Erdoğan, Ç; Demirkasımoğlu, N (2010) . Ailelerin Eğitim Sürecine Katılımına İlişkin Öğretmen ve Yönetici Görüşleri. Kuram ve Uygulamada Eğitim Yönetimi. 16 (3):399-431
  • Erkan S. (2010). “Aile ve aile eğitimi ile ilgili temel kavramlar.” Ed. Z. F. Temel. Aile Eğitimi ve Erken çocukluk eğitiminde aile katılım çalışmaları. Anı Yayıncılık, Ankara.
  • Foster, J. &Loven, R. (1992). The Need and Directions for Parent Involvement in the 90’s: Undergradute Perspectives and Expectations. Action in Teacher Education, 14,13-18.
  • Genç, S.Z. (2005). İlköğretim 1. Kademedeki Okul-Aile İşbirliği İle İlgili Öğretmen ve Veli Görüşleri. Gazi Üniversitesi Türk Eğitim Bilimleri Dergisi, 2 (3): 227-243.
  • Giboney, P. J. (1998). Preservice Teachers’ Knowledge of and Attitudes Toward School and Family Collaboration. (Master’s thesis). Texas Woman’s University, Texas. Available from ProQuest Dissertations and Theses database. (UMI No.1392967)
  • Goldenberg, C, Gallimore, R., Reese, L., & Gamier, H. (2001). Cause or Effect? A longitudinal Study of Immigrant Latino Parents' Aspirations and Expectations, and Their Children's School Performance. American Education Research Journal. 38 (3), 547-582.
  • Graue, E., & Brown, C. P. (2003). Preservice teachers' Notions of Families and Schooling. Teaching and Teacher Education. 19, 719-735.
  • Gu, W. & Yawkey, T. D. (2010). Working with Parents and Family: Factors that Influence Chinese Teachers' Attitudes toward Parent Involvement. Journal of Instructional Psychology. 37 ( 2), 146-152.
  • Haktanır, G.; Akgün, E. (2010). Aile Görüşmeleri. Z.Fulya Temel.(Ed.) Aile Eğitimi ve Erken Çocukluk Eğitiminde Aile Katılım Çalışmaları içinde (s.248-269). Ankara: Anı Yayıncılık
  • Henderson, A. T., & Berla, N. (1994). The New Generation: The Family is Critical to Student Achievement. Washington, DC: Center for Law and Education.
  • Henderson, A. T., & Mapp, K. L., (2002). A New Wave of Evidence: The İmpact of School, Family, and Community Connections on Student Achievement. Austin, TX:Southwest Educational Development laboratory
  • Hickman, C.W., Greenwood, G., & Miller, M.D. (1995). High School Parent Involvement: Relationships with Achievement, Grade level, SES, and Gender. Journal of Research and Development in Education. 28, 125-134.
  • Ho, E.S., & Willams, J. D. (1996). Effects of Parental Involvement on Eighth-Grade Achievement. Sociology of Education. 69 (2), 126-141.
  • Hoover-Dempsey, K. V., & Sandler, H. M. (1995). Parental Involvement in Children's Education: Why Does It Make a Difference?. Teachers College Record. 1 (95), 310-331.
  • Hoover-Dempsey, K. V., & Sandler, H. M. (1997). Why Do Parents Become Involved in Their Children's Education? Review of Educational Research, 1 (67), 325-347.
  • Horn, D. (2003). Preparing Early Childhood Educators to Work in Diverse Urban Settings. Teachers College Record, 105 (2), 226-244.
  • Hu, L, T., ve Bentler, P.M. (1999). Cut‐off Criteria For Fit Indexes in Covariance Structure Analysis: Conventional Criteria Versus New Alternatives. Structural Equation Modeling. 6, 1‐55.
  • Jacobson, A. L. (1991). Parent involvement: A survey of proficiencies of principals and teachers. North Texas University: Denton College of Education. (ERIC Document Reproduction Service No. ED 369 556)
  • Jones I, White C, Aeby V, Benso B (1997). Attitudes of Early Childhood Teachers toward Family and Community Involvement, Early Education and Development. 8 (2), 153-163.
  • Katz, L., & Bauch, J. P. (1999). The Peabody Family Involvement Initiative: Preparing Preservice Teachers for Family/School Collaboration. School Community Journal. 9 (1), 49–6.
  • Kaya, R. (2007). Okulöncesi Öğretmenlerinin Aile Katılımı İle İlgili Tutumları. (Yüksek Lisans Tezi). Orta Doğu Teknik Üniversitesi, Ankara.
  • Keith, T. Z., Keith, P. B., Troutman, G. M., Bickley, P., Trivette, P. S., & Singh, K. (1993). Does Parental Involvement Affect Eighth Grade Student Achievement? Structural Analysis of National Data. School Psychology Review. 22, 474–496.
  • Kirschenbaum, H. (2001). Educating Professionals for School, Family, and Community Partnerships. In D. B. Hiatt-Michael (Ed.), Promising Practices for Family Involvement in Schools (s. 185-208). Greenwich, CT: Information Age.
  • Knopf, H., T. & Swick, K., J. (2008). Using Our Understanding of Families to Strengthen Family Involvement. Early Childhood Education Journal. 35, 419-427.
  • Lamdin, D. J. (1996). Evidence of Student Attendance as an Independent Variable in Education Production Functions. Journal of Educational Research. 89,155-163
  • Lazar, A.. & Slostad, F. ( 1999). How to Overcome Obstacles to Parent-Teacher Partnership. The Clearing House. 72 (4). 206-210.
  • Lee, S. (1994). Family-school connections and students' education: Continuity and change of family involvement from the middle grades to high school. (Doctoral dissertation) Johns Hopkins University: Baltimore, MD. Available from ProQuest Dissertations and Theses database. (UMI No.9523843)
  • Leithch, L. & Tangri, S.S. (1988). Barriers to Home-School Collaboration. Educational Horizons. 66, 70-74.
  • Lindberg, E. N. & Demircan, A. N. (2013). Ortaöğretim Okullarında Aile Katılımının Değerlendirilmesi: Aile Katılım Ölçeği Veli ve Öğretmen Formlarının Türkçeye Uyarlanması. Cumhuriyet International Journal of Education. 2 (3), 64-78.
  • Liontos, L. B. (1992). At-risk Families and Schools Becoming Partners. Eugene, OR. ERIC Clearinghouse on Educational Management
  • Longley, M. J. (1998). Promoting Partnership with Families: A Descriptive Study of the Development, İmplementation, and Evaluation of a Teacher Education Curriculum.(Doctoral dissertation). Portland State University, Oregon. Available from ProQuest Dissertations and Theses database. (UMI No. 9904054)
  • Matunszny, R., Banda, D. ve Coleman, T. (2007). A Progressive Plan for Building Collaborative Relationships with Parents from Diverse Backgrounds. Teaching Exceptional Children. 39, 24-31.
  • McBride, B. (1991). Preservice Teachers’ Attitudes Toward Parental Involvement. Teacher Education Quarterly. 18 (1), 57–67.
  • McBride, B.A., & Lin, H. (1996). Parental Involvement in Prekindergarten At-Risk Programs: Multiple perspectives. Journal of Education for Students Placed At Risk. 1 (1), 349-372.
  • McAnuff-Gumbs, M. (2006). Understanding teachers' Attitudes Toward Barriers To Family-School Partnerships. (Doctoral dissertation) Ohio University, Athens. Available from ProQuest Dissertations and Theses database. (UMI No. 3218015)
  • McQueen, C. D. (2002). Preservice Teachers’ Beliefs about and Experiences with Parents and Parent Involvement. (Doctoral dissertation) The University of Texas at Austin. Available from ProQuest Dissertations and Theses database. (UMI No. 3110656)
  • Moles, O. (1993). Collaboration Between Schools and Disadvantaged Parents: Obstacles and Openings. In N. Chavkin (Ed.), Families and School in a Pluralistic Society (s. 21-49). Albany: SUNY.
  • Morgan, A. E. (2008). Family and Parent Involvement Components in K-12 Teacher Education: A Study of How Universities, Colleges, Schools, and Departments of Education (UCSDEs) in a Southeastern State Prepare Future Teachers for Work with Families and Parents. (Doctoral dissertation). Fielding Graduate University. Available from ProQuest Dissertations and Theses database. (UMI No. 3350576)
  • Moseman, C. C. (2003). Primary Teachers' Beliefs about Family Competence to İnfluence Classroom Practices. Early Education and Development. 14 (2), 125-153.
  • Ndun, T. U. (1994). Family and Consumer Sciences Teachers’ Attiudes and Practices Concerning Parent Involvement in The Educational Process.(Doctoral dissertation). Iowa State University, Ames, Iowa. Available from ProQuest Dissertations and Theses database. (UMI No. 9518419)
  • Pedro, J. Y., Miller, R., & Bray, P. (2012). Teacher Knowledge and Dispositions towards Parents and Families: Rethinking Influences and Education of Early Childhood Pre-Service Teachers. Forum On Public Policy Online, (1).
  • Ramirez, A. Y. (1999). Survey on Teachers’ and Parents Within Rural Secondary Schools. School Community Journal. 9 (2), 21-39.
  • Ratcliff, N., & Hunt, G. (2009). Building Teacher-Family Partnerships: The Role of Teacher Preparation Programs. Education, 123 (3), 495-505.
  • Sabancı, A. (2009). Views of Primary School Administrators, Teachers and Parents on Parent Involvement in Turkey. Eğitim Araştırmaları-Eurasian Journal of Educational Research, 36, 245-262.
  • Schermelleh-Engel, K., Moosbrugger, H., and Müler, H. (2003), Evaluating the fit of Structural Equation Models: Tests of Significance and Descriptive. Goodness-Of-Fit Measures Of Psychological Research Online. 8 (2), 23-74.
  • Slostad, F. A. (1996). Parent Involvement and Preservice Teachers’ Perceptions and Concerns. Doctoral Dissertation, Immaculata Collage, Immaculata, Pennsylvania. Available from ProQuest Dissertations and Theses database. (UMI No. 9708231)
  • Stallworth, J. T. &Williams, D.L. (1982). A Survey of Parents Regarding Parent Involvement in Schools. Austin, TX: Southwest Educational Development Laboratory.
  • Starling, J.L.D. (1991). A study of Elementary and Middle School Teachers’ Attitudes toward Parent Involvement in the Milford School District. (Doctoral dissertation). The University of Delaware, Delaware. Available from ProQuest Dissertations and Theses database. (UMI No. 9223665)
  • Swick, K. J., & McKnight, S. (1989). Characteristics of Kindergarten Teachers Who Promote Parent Involvement. Early Childhood Research Quarterly. 4(1), 19-29.
  • Şimşek, Ö. F., (2007), Yapısal Eşitlik Modellemesine Giriş, Temel İlkeler ve Lisrel Uygulamaları, Ekinoks Yayınları, Ankara.
  • Thompson, K. F. (2012). The Relationship Between Parent Involvement Beliefs of Teachers and Parent Involvement Training for Teachers on Perceived Importance of Parent Involvement. (Doctoral dissertation), Walden University, Florida. Available from ProQuest Dissertations and Theses database. (UMI No. 3502611)
  • Tichenor, M. S. (1998). Preservice Teachers Attitudes Toward Parent Involvement: Implications for Teacher Education. Teacher Educator, 33 (4), 248-259.
  • Ünüvar, P. (2010), Aile Katılımı Çalışmalarına Yönelik Ebeveyn Ve Öğretmen Görüşlerinin Karşılaştırılması. 18 (3). Kastamonu Eğitim Dergisi, 719-730.
  • Wilson, B. (2009). The Assessment of Parent Involvement Preparation in Preservice Teacher Education Programs. (Doctoral dissertation), University of Arkansas, Arkansas. Available from ProQuest Dissertations and Theses database. (UMI No. 3361731)
  • Wilson, S.M., & Wilson, J.D. (1994). Kentucky Parents Respond to Primary Education Reform. Dimensions of Early Childhood, 22 (2), 23-25.
  • Westmoreland, H., Rosenberg, H. M., Lopez, M. E., & Weiss, H. (2009). Seeing is Believing: Promising Practices for How School Districts Promote Family Engagement. Harvard Family Research Project
  • Yao, E. L. (1988).Working Effectively with Asian Immigrant Parents. Phi Delta Kappan. 70 (3), 223.
  • Yazıcı, S. Başol, G.; Toprak, G.( 2009). Öğretmenlerin Çok Kültürlü Eğitim Tutumları: Bir Güvenirlik ve Geçerlik Çalışması. Hacettepe Üniversitesi Eğitim Fakültesi Dergisi. 37, 229-242.
  • Yıldırım, M.C., Dönmez, B. (2008). Okul-Aile İşbirliğine İlişkin Bir Araştırma (İstiklal İlköğretim Okulu Örneği). Elektronik Sosyal Bilimler Dergisi, 7 (23): 98-115.
  • Yurdugül, H. (2005). Davranış bilimlerinde ölçek geliştirme çalışmaları için bazı ayrıntılar, Erişim tarihi: 13.01.2014 http://yunus.hacettepe.edu.tr/~yurdugul/3/indir/FA_OrneklemGe
  • nislikleri.pdf
Birincil Dil tr
Konular
Dergi Bölümü Makaleler / Articles
Yazarlar

Yazar: Çiğdem YAVUZ GÜLER

Bibtex @ { buefad51147, journal = {Bartın Üniversitesi Eğitim Fakültesi Dergisi}, issn = {}, eissn = {1308-7177}, address = {Bartın Üniversitesi}, year = {2014}, volume = {3}, pages = {213 - 232}, doi = {}, title = {Öğretmen Adayları İçin Aile Katılımına Yönelik Tutum Ölçeğinin Geliştirilmesi: Geçerlik ve Güvenirlik Çalışması}, key = {cite}, author = {YAVUZ GÜLER, Çiğdem} }
APA YAVUZ GÜLER, Ç . (2014). Öğretmen Adayları İçin Aile Katılımına Yönelik Tutum Ölçeğinin Geliştirilmesi: Geçerlik ve Güvenirlik Çalışması. Bartın Üniversitesi Eğitim Fakültesi Dergisi, 3 (2), 213-232. Retrieved from http://dergipark.gov.tr/buefad/issue/3815/51147
MLA YAVUZ GÜLER, Ç . "Öğretmen Adayları İçin Aile Katılımına Yönelik Tutum Ölçeğinin Geliştirilmesi: Geçerlik ve Güvenirlik Çalışması". Bartın Üniversitesi Eğitim Fakültesi Dergisi 3 (2014): 213-232 <http://dergipark.gov.tr/buefad/issue/3815/51147>
Chicago YAVUZ GÜLER, Ç . "Öğretmen Adayları İçin Aile Katılımına Yönelik Tutum Ölçeğinin Geliştirilmesi: Geçerlik ve Güvenirlik Çalışması". Bartın Üniversitesi Eğitim Fakültesi Dergisi 3 (2014): 213-232
RIS TY - JOUR T1 - Öğretmen Adayları İçin Aile Katılımına Yönelik Tutum Ölçeğinin Geliştirilmesi: Geçerlik ve Güvenirlik Çalışması AU - Çiğdem YAVUZ GÜLER Y1 - 2014 PY - 2014 N1 - DO - T2 - Bartın Üniversitesi Eğitim Fakültesi Dergisi JF - Journal JO - JOR SP - 213 EP - 232 VL - 3 IS - 2 SN - -1308-7177 M3 - UR - Y2 - 2019 ER -
EndNote %0 Bartın Üniversitesi Eğitim Fakültesi Dergisi Öğretmen Adayları İçin Aile Katılımına Yönelik Tutum Ölçeğinin Geliştirilmesi: Geçerlik ve Güvenirlik Çalışması %A Çiğdem YAVUZ GÜLER %T Öğretmen Adayları İçin Aile Katılımına Yönelik Tutum Ölçeğinin Geliştirilmesi: Geçerlik ve Güvenirlik Çalışması %D 2014 %J Bartın Üniversitesi Eğitim Fakültesi Dergisi %P -1308-7177 %V 3 %N 2 %R %U
ISNAD YAVUZ GÜLER, Çiğdem . "Öğretmen Adayları İçin Aile Katılımına Yönelik Tutum Ölçeğinin Geliştirilmesi: Geçerlik ve Güvenirlik Çalışması". Bartın Üniversitesi Eğitim Fakültesi Dergisi 3 / 2 (Ocak 2014): 213-232.