Serendipity35

Evaluation or Assessment? This was a discussion we had in my undergrad education courses. We also had it in my graduate courses. I ran workshops for college faculty discussion the differences and the hows and whys of using both things. My wife taught a graduate course on program assessment and she will tell you that the two terms are very different.

If you were told that your course or your teaching was going to be assessed this semester, or if you were told that it would be evaluated, would you consider that to mean essentially the same thing?

They are not easy things to define succinctly. Assessment is the systematic process of documenting and using empirical data to measure knowledge, skills, attitudes, and beliefs. The assessment of students or teachers is meant to improve them, not judge, grade or evaluate them.

In education, student evaluation most often focuses on grades. For instructors, an evaluation can be used as a final review to gauge the quality of instruction. It is product-oriented. It is judgmental.

I know that in my time teaching in secondary school and my time teaching in higher education, the way teachers are trained and the ways teachers are evaluated are quite different. Evaluation always occurs. Assessment may not always occur or be seen as equally important.

This discussion also recently appeared online and the kinds of questions being asked are: Is the number of times you talk in class a fair measure of evaluation? If yes, how do we address quiet but observant students? Should you have students do self-assessments and should those be part of the instructor evaluations?

We have been having these discussions for a long time. They are good discussions. Keep at it.

The Chronicle of Higher Education has a forum newsletter series on teaching written by Beth McMurtrie that had a post recently summarizing what they have learned after 5 years of doing the series. As it states, teaching is "An Ever-Changing Profession" and yet I find that many things about teaching are still the same as when I first went into a classroom in 1975.

When I moved out of the classroom as a full-time teacher in 2000, one of my roles was to teach professors. Though the department I ran was instructional technology, I was also tasked with holding sessions on pedagogy. At first, I wondered if college faculty would have a real interest in topics like assessment, grading strategies, creating assignments, and leading discussions in the classroom or online. But in the early sessions, those who did attend (it was voluntary most of the time) often said things like "I try to do what my best teachers do and not do what the bad ones did" and "I never took any courses in how to teach." Those faculty were interested and had spent their academic lives focused on their subject matter and, especially at STEM institutions like NJIT, research and getting grants were the real foci of concern and attention.

It is noted that "teaching has become an increasingly public enterprise," but some say “teaching is a private act.” Certainly, the K-12 classroom has become more public and parents and the community have always played a greater role in what happens in classrooms than compared in colleges. The newsletter points to possible changes to that dynamic, citing "find a teaching buddy, bring the department together to talk about teaching, create teaching communities across campus."

The pandemic and classes going online K-20 put teaching practices more in the public and into homes. Again, that was more so in K-12, but also for higher ed. Schools also held workshops to help faculty shift their teaching and some virtual support groups appeared with topics ranging from how to use Zoom to how to grade participation online.

Though I "learned to teach" as an undergraduate with an education minor in order to be a certified secondary school teacher, I really learned how in my field experiences and even more so in my first few years of actually being a full-time teacher. Like those professors, it took being in a classroom, creating lessons, grading work, and all the day-to-day tasks for me to really learn to teach. But I did have all the theories, practices, and philosophies before I became a teacher to refer to and use. I had tools.

I used a lot of that training in doing my own training sessions for professors. They were always somewhat amazed at all the research that had been done in pedagogy. They were more surprised at hearing there was such a thing as andragogy which addressed the age group many of them were teaching. It shouldn't have surprised them that there was a vast amount of educational research available, after all, it was what most of them did in their own fields. I always suspected that some of that surprise came from an attitude that teaching was less of a science and more of an "art" - like being able to draw or play an instrument. The "A" in STEAM had not found its way into STEM.

The newsletter has covered research universities creating teaching tracks to try to improve educational outcomes and reduce faculty burnout. Innovative forms of teaching, such as inclusive teaching and active learning, are ways that faculty begin to rethink classroom strategies.

I wrote earlier here about teaching AI in classrooms and a former colleague who read it emailed and said that I need to also consider not just how students are learning about AI but also how schools use AI.

In that earlier article, I said that many people are unaware of AI used already in their everyday lives. It's not that the AI is deliberately hidden from view (though in some cases it actually is deliberately hidden, such as with chatbots). If you use apps on a smartphone, you are using AI. If you use Google search or Gmail, you are using AI. If your car has navigation or safety features that keep you on the road, you are using AI.

In education, AI is making it possible to provide more personalized learning experiences for students. By automating tasks that take teachers more time, AI facilitates these tasks so that time can be spent with students providing one-to-one feedback. The AI can evaluate progress, analyze and make recommendations for further study. Digital tools with AI integrations can create a personalized learning path based on each student’s responses and based on their needs. There are platforms that have AI which helps to automate tasks and so can provide adaptive learning and more personalized experiences for students. Students would also have access to intelligent tutoring systems through AI.

Schools using AI administrative;y and pedagogically are more likely to see the value in having students learn in the classroom about how AI works and how it operates in their lives in and out of classrooms.

Should K-12 students be learning about artificial intelligence? Since the turn of the century, I have written about, observed and taught in programs to have all students learn the basics of coding. Prior to that, robotics made big moves into K-12 classrooms. AI seems to be the next step.

I saw recently that DayofAI.org launched a day for classrooms around the world to participate in learning about AI. They offered resources from MIT for teachers, including lesson plans and videos for all grade levels.

It's not that students aren't already surrounded by artificial intelligence in their everyday lives, but they are probably unaware of its presence. That is no surprise since most of the adults around them are equally unaware of AI around them.

You find AI used in maps and navigation, facial recognition, text editors and autocorrect, search and recommendation algorithms, chatbots, and in social media apps. If you have a smartphone to a new car, you are using AI consciously or unconsciously. Consciously is preferred and a reason to educate about AI.

Though I have never thought of my time as a K-12 teacher as training students for jobs in the way that teaching in higher education clearly has that in mind, you can't ignore what students at lower level might need one day to prepare for job training in or out of higher ed. Artificial intelligence, data analytics, cloud computing, and cybersecurity are areas that always show up in reports about jobs now and in the near future.ed workers which means that we need to do more to prepare our students for these careers and others that will evolve over time.

“AI will dominate the workplace and to be successful, people are going to have to understand it,” said Mark Cuban, who launched a foundation in 2019 that provides AI bootcamps for free to students to learn about AI. It is his belief and the belief of other tech leaders and educators that artificial intelligence is something that should and can be taught at all levels, regardless of a teacher’s experience in this field.

One starting place might be Google AI Experiments which offers simple experiments to explore machine learning, through things like pictures, drawings, language, and music. See https://experiments.withgoogle.com/collection/ai

AIClub offers courses for students and free resources for educators including professional development sessions to spark curiosity for learning about AI. They are also developing guidelines for AI curriculum in grades K through 12.

I tried an AI test (it is rather long for younger students) at www.tidio.com/blog/ai-test/ that was part of a survey for a research study about AI-generated content. It shows you images, texts, and plays sounds and asks you to decide if you think they show real people or were created by humans or not. Almost all of us will be fooled by things created by AI. Another site is fun for kids as it shows very realistic AI-created cats that don't really exist. And another site at https://ai4k12.org/ is also a human vs AI activity where you decide whether art, music, writing or photos were created by a human or AI.

All of those examples can be used as a way to introduce students to how AI is used and even caution them to recognize that they can be not only helped but deceived using AI.