Professor Surprises Students With AI Teacher Assistant (smh.com.au) 85
An anonymous reader writes: Jill Watson is an artificial intelligence bot, it is also Ashok Goel's teaching assistant. Ashok Goel, a computer science professor at Georgia Tech, hired Jill Watson to answer questions online for his students so that his teaching staff wasn't so overworked. On average, Goel and his staff receive more than 10,000 questions from students online each semester. So he decided to use IBM Watson, an artificial intelligence system designed to answer questions. After training and tweaking it for months, he was able to spit out good enough answers. Originally, Goel didn't reveal Watson's true identity to his students until after the last final exam was turned in at the end of the class. Students were amazed. "I feel like I am part of history because of Jill and this class!" wrote one student in the class's online forum. "Just when I wanted to nominate Jill Watson as an outstanding TA in the CIOS survey!" said another. Goel is now working to bring the bot to as as many education centers are possible. He expects the bot's question-answering abilities to help online classes, where there's little engagement with a human instructor.
Re: More disgusting attempts by Republicans... (Score:2)
That is why he is not allowed to become president. A social democrat. The last one. It is very sad.
Fail (Score:4, Funny)
Re:Fail (Score:4, Interesting)
Hey, watch it buddy, you're talking about my wife. After decades, she still has her Eastern European accent and teaches grad-level math. Fortunately, by the time they're going for a PhD in math at an American university, the only students left all have thick accents themselves so they don't notice hers. Most of the US students are still struggling with Calculus.
Re:Fail (Score:5, Funny)
Nonsense. Those higher-level math courses are the ones that get used in applied science. For example, my wife's specialty is in numerical analysis and simulation of waves. Used in everything from climate science to wireless communications and acoustics and even nuclear physics.
If you think all math above the level of Calculus is only for academics, then you must be an American.
Re: (Score:2)
To be fair, it used to nearly be true before computers became cheap.
Re: (Score:3)
Also nonsense. No matter how cheap computers get, they don't come out of the factory knowing how to error-correct a wave simulation. For that, you need the BBM equation and for that, you need mathematicians.
Re: (Score:2)
While true, the cost of having a mathematician set up the process and evaluate the output is trivial compared to the cost of having someone work through those equations by hand, and someone else error check everything, and then redo the calculations several times because of trivial errors.
So computers are (currently) limited in how much they can reduce costs, but they have cut the cost of most mathematical procedures immensely, and speeded up getting results event more.
I used to do traffic modeling project
Re: (Score:3, Insightful)
First, it's a misconception that all mathematicians only work by hand. Second, when you say, "set up the process", you are being very vague and almost dismissive. That "process" you refer to is the work of the mathematic
Re: (Score:2)
Unless you're talking about thought processes, then when they don't have mechanical aids, mathematicians work by hand. And the predominate aid is the computer. Slide rules helped engineers a lot, but didn't do that much for mathematicians.
Dissmissive? Not in my mind. The people who set up the process that I implemented not only designed the process, they did a significant study to acquire the relevant correlation factors. This, itself, was a multi-year project, and involved getting a random selection o
Re: (Score:2)
One of the "B"s in BBM never touched a computer for anything but email. I know because I'm pretty good friends with him.
In their dreams.
Re: (Score:2)
I'm not Trump because my wife is not a prostitute.
Re: Fail (Score:2)
No problem. Just use a language pack from the south.
Re: (Score:2)
No problem. Just use a language pack from the south.
Reminds me of years ago when I worked with a fellow from Talladega, Alabama. There I was with my weird Pennsylvania accent - which is more just a lot of made up words like "yinz" "outen" and "redd-up". Him with an incredibly thick southern accent. The other linesmen joked that I was his translator. Anyhow, he was a great guy, and we worked together well, after I figure out what he was saying. Over 6 months, our speech traits started merging, and when I was back at the home office, they wondered what the he
Yes that will help. (Score:1)
"He expects the bot's question-answering abilities to help online classes, where there's little engagement with a human instructor."
This will increase Profits while not realizing that the students questions while answerable show they do not understand the subject.
Goel and his staff receive more than 10,000 questions from students online each semester. That is what happens when you charge the same amount as an in person class, but do not staff it like one.
So read the Text Book pay the fee and you Pass. You
Re: (Score:3)
It's quite possible that the large number of questions is an enabler for this: it's difficult to ask ten thousand different questions about a single subject.
However, regarding the students, if you assume that they won't learn from the answers on their own, why have schools in the first place? And your last claim holds for any classroom: too many people in brick-and-mortar universities pass courses who then promptly forget what they've just learned, so I'm not sure how not having online course helps at all.
L
Re: (Score:2)
No. The optimum ration can be as low a 5:1 depending on the class, but there need to be more students than teachers. And for most adult classes the optimum is probably around 10:1.
That said, 1:1 is a lot better than 20:1...for most classes. Exceptions exist. Imagine, e.g., football being taught 1:1. You couldn't put together even one team, much less two to compete. Sometimes classes need for groups to work together. But always students are inspired by other students working on the same problems. (OT
Re: (Score:2)
No. The optimum ration can be as low a 5:1 depending on the class, but there need to be more students than teachers.
The argument I know about [mit.edu] is concerned with looking for methods of teaching as effective as one-to-one tutoring (but requiring fewer people). Admittedly, since the tutoring doesn't take every waking minute of the student's time, you might get away with more students than one per tutor, but 5:1 seems a stretch. At best you'd get different people for different subjects taught to the student. Learning-wise, why there need to be more students is unclear to me, aside from the obvious issue of cost.
Re: (Score:2)
Don't think of it as tutoring, think of it as a very small class. For most purposes tutoring is not the optimal approach....and what I'm talking about optimizing is quality of learning.
Your reference compared tutoring against a class size of 30, which is far above the optimum for most circumstances. But 1:1 is below the optimum. A study reported by the California Association of Teachers said that for high school students there was a strong fall off of quality when the class size exceeded ... I think it w
Bad bad robot? (Score:2)
Jill Watson: my daddy. Trump was my daddy. Oh daddy, I'm such a bad naughty robot
Surprises... (Score:2)
"And here we are at the edge of the Grand Canyon to test the new plastic brake system - with the look of real metal - which has raised so many eyebrows among American consumers" -- Jackie Stupid - Firesign Theatre "Eat or be Eaten"
"We replaced their coffee with sand and ground up clamshells" -- Saturday Night Live (back when it was good)
--
BMO
Wow (Score:3, Insightful)
So did that thing just accidentally pass the Turing test?
Re: (Score:2)
So did that thing just accidentally pass the Turing test?
IBM has Invested thousands of man-years into the technology -- no, this is no accident that Watson can pass the Turing test.
It can't. The real turing test is a test by an expert, deliberately trying to determine if it is an AI or human.
Re:Wow (Score:5, Funny)
So did that thing just accidentally pass the Turing test?
Pretty much.
Here is an actual transcript of the winning entry.
Student: Where is the homework? I couldn't find it.
TA: That answer is in the Syllabus. Did you not read it?
Student: Ah ok, I found it. I couldn't find the homework in time yesterday. Can I turn in my homework late?
TA: That answer is in the Syllabus. Did you not read it?
Student: I did read it, but I was wondering if you could make an exception.
TA: That answer is in the Syllabus. Did you not read it?
Student: Ok, ok. Thanks anyway.
TA: You're welcome.
Re: (Score:3)
That is how a real TA would have responded. I wonder how JW id?
Indeed, the use of JW tells us a lot about the quality of the answers the human TAs were giving!
Re: (Score:2)
Heh. I had to scroll past a lot of AC comments that wouldn't pass a Turing test to get to yours.
Re: (Score:2)
Ask it about it's mother.
When I was a kid (Score:2)
Re:When I was a kid (Score:5, Interesting)
Re: (Score:1)
As we've learned in today's news, Donald Trump saves money by just becoming his own shills.
https://www.washingtonpost.com... [washingtonpost.com]
The only criticism I have is that Donald gave his sock puppet the same name as one of his kids (Barron). He's got a little something to learn about coming up with better aliases.
Another overhyped chatbot (Score:5, Informative)
From TFA...
Goel and his teaching assistants receive more than 10,000 questions a semester from students on the course's online forum. Sometimes the same questions are asked again and again. Last year he began to wonder if he could automate the burden of answering so many repetitive questions.
The first order of business ought to be updating the course material to answer those frequently-asked-questions, so they don't need to be asked in the first place.
My interactions with professors usually went something like this:
"I don't understand how this answer was arrived at."
Prof scrutinizes the textbook for a while, then says "ah, you have found an error in the text."
I wonder if Jill can handle that kind of interaction with students?
There are many questions Jill can't handle. Those questions were reserved for human teaching assistants.
Ah... the answer is no.
Re: (Score:2)
I wonder if Jill can handle that kind of interaction with students?
Probably not. But there's no reason why a computer system shouldn't be able to do that in principle.
Re: (Score:3)
From TFA...
Goel and his teaching assistants receive more than 10,000 questions a semester from students on the course's online forum. Sometimes the same questions are asked again and again. Last year he began to wonder if he could automate the burden of answering so many repetitive questions.
The first order of business ought to be updating the course material to answer those frequently-asked-questions, so they don't need to be asked in the first place.
My interactions with professors usually went something like this:
"I don't understand how this answer was arrived at."
Prof scrutinizes the textbook for a while, then says "ah, you have found an error in the text."
Your interactions were atypical. I taught 5 semesters of digital design, the text was right (though the simulator had its faults.) The questions were 60% answerable by finding the appropriate paragraph in the current textbook, 30% answerable by finding the appropriate paragraph in a pre-requisite course's textbook, and 10% best answered by reminding them of the drop-date deadline.
Re: Another overhyped chatbot (Score:2)
Most likely most of these questions are mentioned in the syllabus. The rest could have been googled or easily solved by thinking or reading course material.
Re: (Score:2)
The first order of business ought to be updating the course material to answer those frequently-asked-questions, so they don't need to be asked in the first place.
In my experience teaching college students, most of them don't read the syllabus or anything else I hand to them. Then I get questions from students about things that were explained on the syllabus. I have stood in front of a room full of students and stated a simple fact that had been printed on the syllabus (the exam will be next Tuesday, the 24th) and then called on a student who had his hand raised, who then asked when the exam was going to be because he hadn't been paying attention.
As an instructor,
Such as? (Score:2)
My wife asked a key question (Score:1)
Without work as a TA, my wife could not have earned two Master's degrees. She wouldn't have her career. I wouldn't have met her. That would be very, very bad.
How is our economy supposed to work?
TA isn't the only job (master's student here) (Score:2)
I'm a master's student myself. I have a job that's NOT a TA job. Several students are employed where I work. We're getting real-world experience in the field, as opposed to even more time around a school like a TA does.
Come to think of it, my job pays about four times as much as a TA position pays too.
Re: (Score:3, Insightful)
The answer is Socialism
People have seen this day coming ever since the industrial revolution first starting taking jobs away from farm workers. This is why some countries are now looking at Universal Basic Income, because mechanization of tasks has made us TOO efficient, and there just isn't enough work to go around.
Re: (Score:2)
Depends on what kind of work you find necessary. If you just need shelter constructed, water and food delivered to it, and electronically delivered entertainment, that's fast approaching 100% automated, if you don't mind living in a pre-fab house. If you want your toilets scrubbed, windows washed, landscaping manicured, vehicles detailed, clothes tailored and laundered and pressed, you'll need to be paying people to do that for some time to come. So, there's that kind of work out there, still - but with
Re: (Score:2)
For the time being, sure, but between motion capture and machine learning, this is fast being automated as well. And for actual programming programming, well, AIs will be able to do that too soon enough, and then where will you go?
Re: (Score:3)
Cynically, the 99% have always scrubbed toilet, built luxury goods, provided military services, and worked to increase the wealth of the 1%.
The robots are basically owned by the 1%, so the 99% will be serving the robots too. Long term: whether that's maintenance and repair, or providing chaotic original thought Matrix style, remains to be seen.
Re: (Score:1)
Re: (Score:2)
The robots are supposed to do all the work for us... we just have to learn how to build and service them.
Cool story, but... (Score:2)
From the article:
Ashok Goel, a computer science professor, did not reveal Watson's true identity to students until after they'd turned in their final exams.
And...
"A really fun thing in this class has been once students knew about Jill they were so motivated, so engaged. I've never seen this kind of motivation and engagement," Goel said. "What a beautiful way of teaching artificial intelligence."
Which was it?
Or is he saying they were demotivated and not engaged the whole semester?
Re: (Score:2)
Boy is he in for a suprise (Score:2)
infinite patience (Score:2)
Welcome to the future, where instruct-o-bots replace meatware in parts of higher ed. Whatever will the next generation of Grad Students do for fun (and money)?
The reason Jill was so loved (Score:2)