You must log in or register to comment.
Yeah but for real proof of understanding has always been a problem. One of the reasons generated text is so pernicious is because even in everyday life, it outwardly mimics all the signals of care and cognition.
To the main point: much smaller class sizes is how you solve this problem.
My students can use a translator for every interaction they have forever, or they can do the homework and try to learn the language. Three guesses as to what’s actually easier in the end. Just because it can be done by a computer doesn’t mean there’s no reason for a human to learn it.
The thing that this person seems to have either forgotten, or not understood in the first place, is that homework, and your education in general, is not for the teacher, it’s for you. If you choose to cheat your way through you will gain less than if you actually put the work in yourself. This gets more important the further through education you go.
Probably the best outcome for an essay question is if you discuss it with your friends, all share your understanding of the subject, then write it up individually, incorporating anything new you learned from your discussions.
This does come with the issue that those who cheat could end up getting good grades if there is no ‘live’ check of their understanding, either through closed book exams, class tests, group discussions, or similar.
When I am struggling with Language Arts and excelling at Math, the extra time spent on unmastered Language homework benefits me. The extra time spent on Math serves only to waste my time and distract me from the Language work that needs my central focus.
The intention of homework is to benefit the student. The reality is that most students would be best served by skipping the homework and getting some exercise instead.
In the gradebook, the unit test score should be the floor for all homework scores in that unit. Score a 95% on the test, and even if you turn in zero homework, a 95% should be recorded for each assignment. S
Turn in 95% on each and every homework assignment, but score a 65% on the test? You keep your 95% scores showing you put in the work, even though you clearly haven’t mastered the material.
Turn in no homework, and score a 65% on the test? Every homework assignment is now a 65%.
With this system, doing the homework can only help you. Skipping the homework is risky, but allowable.
your education in general, is not for the teacher, it’s for you
Most teachers don’t understand that
Indeed, it’s not that LLM is totally uncorrelated to factual basis, it is correlated well enough for most educational fodder that is supremely well trodden and doesn’t seek surprises. It’s practice with backgrounds the teachers can actually already know and credibly provide feedback on. It’s so well known that any teacher knows, so it’s correlated with AI output that has been trained on verbatim prompts and essays that are on the exact same topic, and so the narrative correlated with the prompt is just very likely to also correlate to the facts of relevance.
Just like a pocket calculator can make short work of elementary school math. It’s not that we expect those kids to do some crazy novel stuff that calculators can’t do, it’s just that they need to operate in a context to actually illustrate they have the foundational understanding.
Depends, with homework, the goal is to learn, but with tests, it’s already less clear, a good teacher needs to know the level of it’s class in order to curate it’s teaching to their understanding. Moreover, some formation recruit based on grades and in this context, the point op is making is very relevant
You were so close. Right up until you mentioned closed book exams. How many times in your job have you ever not been allowed to look something up? The reality is that closed book exams only test your memorization capabilities and some of us don’t memorize shit very well. The best teachers allow open book exams because if you know where the information is then you can find it in time but if you don’t know where the information is you’re not gonna be able to take the test in the time given.
I’m a language teacher. It happens all the time that I want to say something and can’t look it up. Think about the last time you were in a group of six or more people: the conversation doesn’t stay on one topic long enough to look up a word before responding to someone’s comment. I also wouldn’t want to take a moment to double check a word and hold up the whole line when the cashier at the grocery store asks me a question.
How many times in your job have you ever not been allowed to look something up?
It’s rare, but not unheard of, that I can’t look things up, but the point of closed book exams is is to demonstrate that you know the subject well enough that you don’t need to look things up. Obviously, exactly what this entails is going to vary depending on the level if the exam. If it’s testing foundational knowledge, then it should all be in your head, if it’s more advanced, a crib sheet with key facts (say certain more complex, but necessary, equations for a non maths subject, or similar support prompts).
If you’re working, you can’t be stopping every few minutes to look up basic information. A computer programmer who has to keep looking up the syntax of their language, or basic algorithms, for example, won’t get very far.
The algorithms one in particular is a bugbear of mine, because if you don’t already know the computational complexities of the operations on the common basic data structures then no way are you taking the time to look them all up each and every time you declare one. And yet one of the bitchwhiniest complaints I frequently see online about coding interviews is how dare hiring managers ask you to prove you understood CS201 Data Structures & Algorithms…
I’ve been a computer programmer for 15 years, Not once have I ever been in such a time crunch that I couldn’t double check something.
There’s a big difference between double checking things occasionally, and needing to look up fundamental things. I’ve been a sysadmin for, well, a long time, and there have been many occasions where I’ve been pulled in to rescue a situation and had to rely on what I knew, without being able to refer to other material, either due to intense time pressure, or enough being down that there isn’t anything to reference.
Besides, exams should be testing your core understanding of the subject, the sort of knowledge everything else is built on, and your ability to apply that knowledge in different scenarios. Practical tests, are better suited to assessing how you use novel information, do more advanced things, and handle reference material. Maybe we’re talking about the same sort of thing in different ways?
I think both closed book exams, and practical tests/discussions and the like have an important role to play in assessing your performance, whether a teacher sets them or you challenge yourself.
This is one of those “you won’t need it, but the smart kids will” things.
I’ve used Pythagoras at least four times in my professional life, and not one of those occasions was the problem presented to me in the form of a neat “Here is a right-angled triangle; what is the length of this hypotenuse?” that I could have then looked up in response if I didn’t already know.
Right, but that’s not the point I’m trying to make. The point I’m trying to make is during any of those times was there a point in which you couldn’t look up what the Pythagorean formula was?
I feel like you haven’t understood my point either. If I didn’t already know Pythagoras, I wouldn’t have known that it was a valid solution to the problem I had, therefore I wouldn’t have known to look it up.
No, that was literally my point. That it’s more important to know how to find information and where the correct information is then it is to memorize the exact information. Knowing Pythagoras and having the formula memorized are two very different things especially for things that get more complicated than Pythagoras.
deleted by creator
Yes, but, if you can’t produce plausible bullshit on your own you’re not going to get very far.
if 90% of jobs can be replaced by AI bullshit, why tf do we even need to work? Why shape society so you must do shitty non existent jobs to survive?
Automation should enable UBI, in a decent society. But since our current leaders will never implement UBI, automation is a crime against the working class who need jobs to survive.
Correct answer, we are already in the UBI realm of not needing enough workers. The question is where the world goes from here. I’m currently betting on some dystopian societal structure we’re 90% of people are fucked. So glad I’m older without kids.
May I introduce you to the work of David Graeber on this exact subject? Bullshit Jobs
I forgot that he also wrote that. I read “the dawn of everything” which is one of the most mind-blowing revision of history I’ve ever seen. (In a good way, for once)
I recently finished it and it completely changed how I see society. It’s the intellectual equivalent of an acid trip, with how much it breaks down and challenges things you’ve just always assumed.
I also recently read Debt and The Utopia of Rules. I highly recommend people read everything of his.
Thanks for link!
Anytime!
if 90% of jobs can be replaced by AI bullshit
Well, to start, they can’t.
At least not by these LLMs that keep getting touted as AI.
Synthesis: Learning is a mistake, return to ignorance, just figure stuff.
Think about it, do you really think it’s a coincidence that all major religions reject asking questions??
Can’t tell if you’re being serious or doing a bit, but playing along, it’s no coincidence because most major religions want to act as the Source of All Knowledge for people and asking questions makes that more difficult. The ones that didn’t ban questions probably didn’t get as popular, other than maybe Buddhism, though I don’t have any direct experience with Buddhism as a religion, more just its philosophies that do seem to encourage thought and questioning (but then again, Christian philosophy seems to encourage generosity and kindness but how much that is truly valued seems to vary quite wildly by congregation and/or sect).
Though I’d also say that the return to ignorance is well underway.
Uhm no?
First of all, humans and machines work in very different ways. I haven’t met a human who could produce correct facts without actually knowing them. And if a human can deduce a correct answer given enough information, is that bullshit or critical thinking?
Second of all, “plausible sounding” is not what you need to pass an exam. “Factually correct” is what you need.
Though this doesn’t seem like a valid application of TAS, I’ll bite.
A calculator can do your math homework for you, but that doesn’t mean the homework is useless. It means that if you don’t follow the rules the work is useless. Just because something with no understanding can complete a task doesn’t mean a human with no understanding can. It is built to test a human, not a computer, and it generally does so well enough provided the human is the one doing the work.
Yeah it’s built to serve as practice and to leave you with the questions you need to ask the next day.
I get it. I hated homework in school and generally didn’t do it. And a fair bit of it was busywork. But when I got to college I learned the hard way that if I didn’t do my homework, I wouldn’t really have the skills. It’s easy to sit through classes daydreaming or even listening, and just not really understand how to do a thing.
I mean this is exactly what all the kids who told me they loooved essay questions always said they liked about them.
same, they all love cheating, before AI they would mostly just copy paste eachother’s work
and me the alone kid who actually wanted and cared about learning would be drown out in busy work to be done, get bad grades even though I did well in tests and exercises, simply because I failed to do the annoying boring homeowrk of writting an essay that we all know the teacher is not reading, that they just made thjs assigment to give students free grade points because they know that if they didn’t half of the students would fail the class, they would go lenghts about how they were being nice by doing this, and yet screwing over me would never be mentioned, one of the few students that ever displayed any form of curiosity in class
It’s too bad, now we’ll have to replace them with speaking in front of the class without notes.
I would love that!
I wouldn’t mind. Some would struggle.
I taught a class of eight students who liked each other and got along well (but weren’t dating each other) for twenty hours a week for six weeks. They were all still terrified to give presentations at the end, even though it was a language course and they all already spoke a lot in class. I don’t know how I could make it easier for them, because that’s just about the lowest stress scenario I can set up. I’m not judging them for it, because I had a couple moments of panic in front of them as well, sometimes it happens, but I’d like to make it less stressful. I could just have them do it every day to make it routine, but if some of them are really affected by it, that might just make them dread the class.
Public speaking is a dying art, with the potential to change the world. People just aren’t given enough exposure in the right circumstances anymore. All we need is a place where it’s safe to fail, and all that nervous energy becomes a vibrant excitement with no comparison.
i can tell you from experience that teachers are using it too lol, to create the homework
one of my university professors admitted that he used copilot to create some questions for our exams of that class 🙃
I tried it for my class, and the questions they come up with is boring, repetitive, and generic.
I feel very sorry for you that you need to endure that.
Would this be better than recycling the same 5yrs worth of material?
What’s wrong with recycling material? If it’s decent, it’s still gonna be useful for a new class…
When your exams are all the same questions every year just in different orders and all your exercises are on obsolete software, yeah, it’s a problem. Even worse is when the prof doesn’t even look at your work and just gives a mark based on his feels that day. I did extremely well in that class, but all I learned was I forgot something in an autoexec.bat file, I didn’t realize it went 1 line past the bottom of the screen with a silly broken command
Autoexec.bat… you’re over fifty :p so am I though :(
This was a class in 2012, and yes. I remember putting “win” in my auto exec so I didn’t have to type it lol
Then you had a bad professor and the homework was useless. What class was it?
software engineering processes (the name is in french, this is my best attempt at a translation)
but many of my classes this semester had ai slop in them lol, one of them had nonsensical ai generated images in the class notes, in another one the teacher used cursor as his IDE to demonstrate stuff…
my classmates are all in on it too, naturally. for one project, one of my teammates announced that he’d already done most of the work! wow, so cool, and so early too! in hindsight i should’ve seen it coming… basically the whole thing was vibecoded and i only noticed at the end when it was time to do minor adjustments (such as fixing major features that were not working lol)
AI is terrible in university. Because there is minimal effort on the students to produce it, and the hours I waste marking it is wasted. Pointing out the errors produces no value since The students didn’t go through the process in the first place, and the machine isn’t listening.
I see the same thing in my day job. Analysts produce effortless reams of bullshit that technical experts like myself have to wade through and proof read. We are seen as the barrier, but the more AI is used the longer the review takes because there was no quality control on the generation of the material.
Every gdn teacher in the world knows that, or at least should know. It’s next to impossible to create tests that would measure understanding, and actually using that kind of tests in real life would be so time-taking and slow that schools and universities would grind to a halt.
As notabot below says, homework (and exams) are for the student. The “measuring” aspect in them gives only a sign that the student should note and act on (and of course, the society being what it is, the “measures” are also used in other ways whether we like it or not).
Same reason Paul Blart should get off that Segway and walk. It’s less convenient but it makes you stronger.
While it is very easy to trick chatgpt 3.5 into submission, modern models, especially paid ones are hard to trick while not giving students without AI an disadvantage.
So the alternative is making the class very verbose and/or require much deeper understanding and novelty that is beyond the scope of a introductory class (which most undergrad/grad classes are).
For now, what I am doing is just making the homework optional or worth very little, and grade based on exams, quiz, participation, and projects. Since everyone will get perfect score on homework anyway, so there is no point in evaluating that nowadays :(
One of my uni lecturer friends set a task that required students to ask GenAI to produce an essay, and then the actual task was to critique the essay (in class, I think).
Is this meant to be pro-AI? Because people can be fooled by plagiarism?
I read it as anti-homework.
The idea with homework is to have the knowledge stick.
Homework 100% helped reinforce key parts of my education. By college i got better at deciding which stuff to do and which i could skip. The more i dreaded the class and the homework, the more important doing it tended to be. On the flip side, my math course that was more of a refresher of high school math, i could skip 90% of the homework.
The idea of homework is to condition us to accept poor work-life balance.
By all means make stuff available for students who want it, but if students need extra work that can’t fit in class, then the school day should be longer.
Homework at an elementary and middle school level is kinda an equity issue because not everyone has a stable home life. But in high school and college, it makes sense to drill the harder concepts and to get a chance to produce high-quality project-based work.
That’s why trump is where he is today. The Art of Bullshit.
How is anyone using ChatGPT in an exam? Surely exams are taken in controlled conditions?
Most of my exams have been online with no proctoring… Hell most of them are meant to be open note I think. That or my class just does a final project or paper rather than an exam. I’ve only had a few in person on paper final exams, and one online proctored exam where you have to scan your surroundings before testing.
I hate AI so I’d never use that to cheat (plus that shit is obvious and often wrong anyway), I just look at my own notes because I wrote them for a fucking reason. But like most of my exams or papers could’ve been done with AI I guess. Or like someone said go to the bathroom with your phone, as I’ve never had to hand over my phone before an in-person exam.
Honestly highschool was more serious about devices when I took state tests/finals and the ACT, they either took it or it had to be in a bag completely turned off, and if you did take a bathroom break (which was HIGHLY discouraged and I think only available during certain times), you had to hand over your phone.
in my uni i heard students say they took their phones with them to the bathroom
That is absolutely wild.
When I was at uni (2016-2019), you had to leave all of your belongings behind in a designated area, and only carry a clear/transparent container with your pen(s) to the exam room. You could optionally bring a clear water bottle (label removed.)
If you ask to use the bathroom, there is no opportunity to go back to your belongings.
I’ve gotten my period by surprise during an exam, I’m glad I didn’t go to a university like that.
In my uni you could pee when you handed in your test. Unless you got disability accommodation (I got a separate room so I could pace while I thought because adhd) where you had to hand over your phone and everything else not necessary for the test.
