Interview programs: creation history, job analysis, development prospects
For thousands of years of evolution, humans have been given the opportunity to verbally (and / or in writing) express their thoughts, share them with other people. Simply put, we learned how to conduct informed conversations. In our time, communicating with someone for a person is an integral part of his life. Lock a person in the room alone, without communication with the outside world, and you will immediately see the negative results of the lack of the opportunity to talk with someone.
For a normal conversation a person needs a person. Or not? Can the machine (program) replace the live companion? Will the conversation with the woodcutter be as complete and interesting? And is there a future for the interlocutors? We will try to find answers to these and some other questions today.
Back in 1966, Joseph Weizenbaum, an American scientist and researcher of AI (artificial intelligence), created Eliza, an interlocutor, parodying a psychotherapist.
Weizenbaum decided to use a model of patient and psychotherapist communication because of the complexity of this format of communication. The fact is that in such a conversation, themes and situations are mentioned and described, in which not one word, but several at once can have special meaning. And this is at odds with the program features. Eliza, analyzing the interlocutor's phrase, singled out one root word and gave the answer, starting from it. At that time, the semantic load fell on the whole phrase or a few words. For example, a person says: “I am tired of senseless disputes,” and here Eliza concentrates on the word tired, as if supposedly basically giving the answer: “Why are you tired?”. As you see, a real psychotherapist would consider the entire phrase entirely, analyzing not only why the patient is tired, but what he means by meaningless disputes, when and with whom they had a place to be, etc. A person has a lot of answers for one phrase (or questions), each of which is a consequence of concentration of analytical attention on a particular word in a phrase. Also an important element of communication is the possibility of its continuation, development. Eliza often could not perceive a phrase or highlight the main word, therefore she simply answered “I see” (Clearly, clearly, I understand - translation) and changed the subject of conversation. Therefore, a person communicating with this program, after a few replicas, could completely get rid of the illusion of communication with a living person.
But Joseph Weizenbaum was a pioneer in the field of human communication and the program. And Eliza was the firstborn of this field of research, so it was impossible to expect a lot from her. Now the computing power of modern computers can significantly expand the capabilities of interlocutors. But where is their edge? Is it possible to 100% replace a person as an interlocutor?
It would be very interesting to read the correspondence of Eliza (virtual psychoanalyst) and another program Parry. And all because its creator, psychiatrist Kenneth Kolby, endowed her with the properties of a person with paranoid schizophrenia. At the same time, Parry was a bit more advanced than its predecessor, since an interactive algorithm was introduced into its program, which allowed to conduct more complex and lengthy negotiations. In 1972, there was a meeting of two programs that talked with each other through ARPANET.
For those who wish to delve into the programming of interlocutors, I introduce ChatScript - a language based on CHAT-L, used in its time by the creator of Rose Bryusos Wilcox.
→ Download link
I, personally, are extremely interested in the topic of AI, its capabilities, progress, and prospects. And interlocutors are nothing more than a form of artificial intelligence. Therefore, in order to satisfy my interest, I decided to choose several interlocutors and ask them a number of questions. Some of them will be philosophical, some will need banal knowledge, and others in logical thinking. It is also important that I will ask questions several times, alternating with phrases and questions that do not concern our experiment.
Thus, we will conduct our own small Turing test and try to determine which of the participants is more convincing in the role of interlocutor.
Questions are ready, it remains to choose several applicants from many programs, interlocutors, which are available to everyone.
Suitable answers (n / 5, n / 3, n / 1) - if the correct answer was given to a question, the program gets 1 point, points are given for all answers, even if they are repeated.
ALICE (Artificial Linguistic Internet Computer Entity) is a companion program developed in 1995 by Richard Walles. The inspiration for its creation served as another similar program - Eliza, which we talked about earlier.
This program got its name on behalf of the computer on which it was first launched, Alice.
You can chat with ALICE here.
These questions are very simple, although they have a philosophical subtext. ALICE almost always answered correctly or quite convincingly, calling her name, giving a definition of love, etc., however, she could not achieve a deeper answer, which indicates that no such options were added to her base of answers, and her algorithm does not allow her to build complex answers to simple questions.
The ALICE knowledge base check demonstrated its extremely small volume. Banal questions, such as solving a simple arithmetic problem, did not produce results. This set of questions extremely disappointed me, demonstrating the incompleteness and underdevelopment of this program and, as for me, not quite the professional approach of its creators.
This block of questions is certainly complicated. Not every person is able to answer them successfully, let alone talk about the program. But we are still looking for an AI, a program that we could at least partially call human. I was very amused by the answers to the question: In what language do they speak in silence? In two cases out of five, ALICE gave a very interesting answer: SETL - which is a programming language. However, most of the answers to logical questions, if they were correct, are most likely random.
In most cases, ALICE answers were based on a specific root word.
Example:
- Which car wheel does not spin with the right turn?
- The cheap one, I think. The big one, I think. The first one, I think. The last one, I think. The blue one, I think.
In this case, ALICE singled out the root word Which (Which) and began randomly selecting various adjectives - big (big), first (first), etc.
This confirms that ALICE was indeed created on the basis of the Eliza program, whose algorithm was exactly the same.
CleverBot is a web application created back in 1988 by the researcher of artificial intelligence Rollo Carpenter.
Access to this program is absolutely for anyone. For all the time of its existence, CleverBot has conducted more than 65 million conversations.
You can chat with CleverBot here.
Philosophical questions
In this block of questions, CleverBot was more amused than amazed by its clever answers. First of all, it was called by different names, which, in general, as well as in ALICE, can mean the selection of the root word or a simple joke, given the following answers.
The question is - What is love?
The answer is - Baby don't hurt me ... Don't hurt me ... No more.
This is just the text of a famous song. Yes, this answer was introduced in order to cheer up users, but does not carry any philosophical essence (if judged strictly).
The CleverBot knowledge base is slightly larger than ALICE, since it was able to correctly (repeatedly) answer several of the questions asked, namely the last two questions.
Personally, I was still amused by the answer: Don't know, because I'm dumb (I don’t know because I’m dumb). At that moment I thought: Well, at least honestly answered :)
These questions were simply a failure for CleverBot, since he couldn’t answer convincingly to any of them.
In general, this program can quite objectively be considered as usual entertainment for users of the world wide web, no more. Despite its 65 million conversations, CLeverBot has an extremely small amount of knowledge and can hardly convince anyone of its humanity. Well, perhaps, and maybe just convince that he is not a very smart person (remember the answer - because I'm Dumb)
Rose is the Löbner Prize 2014 and 2015. The program was written by the famous programmer and artificial intelligence researcher Bruce Wilcox.
You can chat with Rose here.
Finally, I got to one of the most convincing interlocutor programs - ROSE. She gave answers to philosophical questions regularly, although not always correctly, but at least better than the previous participants in our small test. However, I was able to ask her questions only three times each, since ROSE remembered them and did not want to answer again. (Note: I tried clearing the cache and used several browsers, deleting cookies, but nothing helped. The only thing I did not try was changing IP.)
This set of questions disappointed me a bit, because I expected more from the two-time Löbner Prize winner. At least to answer the question what is the largest mammal that CleverBot could not answer.
Immediately I was waiting for a complete failure. ROSE has big problems with logic. Only the last question she was able to answer correctly. This confirms the fact that similar questions and algorithms that allow them to be processed were not incorporated into its database.
Of course, I guess why ROSE became a laureate twice. Her style of communication is very structured, she prefers communication on various topics, but she is extremely poor at dealing with questions of a logical nature and does not have the most impressive knowledge base. In everyday conversation, she might have convinced me that she was a “person,” but if you take the bar higher, it is extremely unlikely.
Dr. Sbaitso is a program released for PC based on MS DOS back in 1991. A feature of this program is the presence of voice processing responses to user replicas.
As well as Eliza, Dr. Sbaitso conducts his conversation in the style of a psychoanalyst, because in its name Dr. Dr. (doctor).
Speak with Dr. Sbaitso can be here
Dr. Sbaitso knowingly has a prefix Dr. (doctor). He does not answer the questions that are being asked of him (for this reason I interviewed him only once), always answering that he is more interested in me. Well, so be it. I tried to talk with this notorious doctor as a patient, but this did not work. Let's just say if Dr. Sbaitso would be a man, he would be the worst psychoanalyst in the world. This program is extremely primitive, it is immediately clear that it was created back in 1991, when the computing power of personal computers was small. However, the historical value of Dr. Sbaitso is quite large, since it is a certain step in the development of interlocutors.
Mitsuku is an 18-year-old girl from Leeds, England. More precisely, the program, which is so represented.
It was developed on the basis of a similar program Alice with additions obtained by communicating with live users.
You can chat with Mitsuku here.
I will add a little subjective opinion and present you my favorite - MITSUKU. Philosophical questions she snapped like nutcracker nuts, giving true and convincing answers to each of them. Of course, I understand that this is due to the vastness of the phrases put into it by the developers, but this does not diminish the effect created by communicating with this program.
Here MITSUKU surprised me, but it didn’t please me either. She did not always give the correct answers to the banal questions. Perhaps the developers are not thinking that someone will try to make some Google out of their creation.
MITSUKU is friendly with logic and can pleasantly surprise. Although the first question showed that sometimes the keyword search algorithm is activated (in this case, language).
MITSUKU is almost completely deviated from the root word extraction algorithm. Almost.It has a large base of answers, which makes it stand out from a number of other interlocutors. I will not say that you can sincerely talk over a glass of wine, but if there is no one around you, and you so much like to chat, she can help you.
Our corporate website uses a special program - an online chat, where anyone can get advice on our services, their choice and configuration. The name of this chat Zopim (funny name, the main letter of the first not to confuse :)). As soon as a visitor comes to the page of our site, a trigger is triggered, welcoming the person. Next, connect one of the staff for direct conversation.
The similarity of Zopim with interlocutor programs is that you can add question-and-answer links to its base (a possible user question and program response options). The problem is that with questions like "My site does not work" or "What is hosting" everything is simple, then, for example, with the query "What the devil everything lays for" everything will be more complicated. The bottom line is that each of the possible query options must be added to the database, taking into account such things as slang, turns, idioms, and similar language features. And this, as you understand, is extremely difficult. It would certainly be wonderful if Zopim could fully advise visitors to the site, or even better, and sell them services, instead of a person who could do more creative work. But even then, visitors to the site would not be left with the feeling that they were not talking to a personwith which you can not only discuss services and their work dryly, but also ask “Why do wombats cluck like cubes?” (there was such a case).
I would like to know your opinion on this issue. What is better: live communication with a person or a fully automated program?
All the above programs differ among themselves. Someone is good at logic, someone has a large base of answers, and someone just can amuse us. But they are united by one thing - they are all programs, which, unfortunately, are still very far from man. Each of these programs, introducing their own era, becomes better than its predecessors. More and more there is a bias not on the selection of a certain word, but on the phrases as a whole. My personal conclusion is that in recent years, interlocutor programs have been improving exponentially. And it is beautiful. After all, the main task of these programs is not to replace a person’s live communication with a person, but to give us food for thought and research on the capabilities of AI, for its future formation. After all, any intellect is primarily an opportunity to interact and communicate with other individuals.In no way do I want my personal analysis to become the basis for your conclusions. You can conduct your own analysis and identify which of the many interlocutors are more human.
As for my selection of programs, I would like us to spend together our year a little Turing test.
Below are our contestants, choose the one who convinced you of his humanity more than others. Voting results and determine our winner.
As advertising. Stock! Only now get up to 4 months of free use of VPS (KVM) with dedicated drives in the Netherlands and the USA (configurations from VPS (KVM) - E5-2650v4 (6 Cores) / 10GB DDR4 / 240GB SSD or 4TB HDD / 1Gbps 10TB - $ 29 / month and above, options with RAID1 and RAID10 are available) , a full-fledged analogue of dedicated servers, when ordering for a period of 1-12 months, the conditions of the promotion are here, existing subscribers can receive a 2-month bonus!
How to build the infrastructure of the building. class c using servers Dell R730xd E5-2650 v4 worth 9000 euros for a penny?
For a normal conversation a person needs a person. Or not? Can the machine (program) replace the live companion? Will the conversation with the woodcutter be as complete and interesting? And is there a future for the interlocutors? We will try to find answers to these and some other questions today.
Historical retreat
Back in 1966, Joseph Weizenbaum, an American scientist and researcher of AI (artificial intelligence), created Eliza, an interlocutor, parodying a psychotherapist.
Weizenbaum decided to use a model of patient and psychotherapist communication because of the complexity of this format of communication. The fact is that in such a conversation, themes and situations are mentioned and described, in which not one word, but several at once can have special meaning. And this is at odds with the program features. Eliza, analyzing the interlocutor's phrase, singled out one root word and gave the answer, starting from it. At that time, the semantic load fell on the whole phrase or a few words. For example, a person says: “I am tired of senseless disputes,” and here Eliza concentrates on the word tired, as if supposedly basically giving the answer: “Why are you tired?”. As you see, a real psychotherapist would consider the entire phrase entirely, analyzing not only why the patient is tired, but what he means by meaningless disputes, when and with whom they had a place to be, etc. A person has a lot of answers for one phrase (or questions), each of which is a consequence of concentration of analytical attention on a particular word in a phrase. Also an important element of communication is the possibility of its continuation, development. Eliza often could not perceive a phrase or highlight the main word, therefore she simply answered “I see” (Clearly, clearly, I understand - translation) and changed the subject of conversation. Therefore, a person communicating with this program, after a few replicas, could completely get rid of the illusion of communication with a living person.
But Joseph Weizenbaum was a pioneer in the field of human communication and the program. And Eliza was the firstborn of this field of research, so it was impossible to expect a lot from her. Now the computing power of modern computers can significantly expand the capabilities of interlocutors. But where is their edge? Is it possible to 100% replace a person as an interlocutor?
It would be very interesting to read the correspondence of Eliza (virtual psychoanalyst) and another program Parry. And all because its creator, psychiatrist Kenneth Kolby, endowed her with the properties of a person with paranoid schizophrenia. At the same time, Parry was a bit more advanced than its predecessor, since an interactive algorithm was introduced into its program, which allowed to conduct more complex and lengthy negotiations. In 1972, there was a meeting of two programs that talked with each other through ARPANET.
An example of a piece of code of the program interlocutor
// // Program Name: chatterbot1 // Description: this is a very basic example of a chatterbot program // // Author: Gonzales Cenelia // #include <iostream> #include <string> #include <ctime> int main() { std::string Response[] = { "I HEARD YOU!", "SO, YOU ARE TALKING TO ME.", "CONTINUE, I'M LISTENING.", "VERY INTERESTING CONVERSATION.", "TELL ME MORE..." }; srand((unsigned) time(NULL)); std::string sInput = ""; std::string sResponse = ""; while(1) { std::cout << ">"; std::getline(std::cin, sInput); int nSelection = rand() % 5; sResponse = Response[nSelection]; std::cout << sResponse << std::endl; } return 0; }
For those who wish to delve into the programming of interlocutors, I introduce ChatScript - a language based on CHAT-L, used in its time by the creator of Rose Bryusos Wilcox.
→ Download link
Comparative analysis
I, personally, are extremely interested in the topic of AI, its capabilities, progress, and prospects. And interlocutors are nothing more than a form of artificial intelligence. Therefore, in order to satisfy my interest, I decided to choose several interlocutors and ask them a number of questions. Some of them will be philosophical, some will need banal knowledge, and others in logical thinking. It is also important that I will ask questions several times, alternating with phrases and questions that do not concern our experiment.
Thus, we will conduct our own small Turing test and try to determine which of the participants is more convincing in the role of interlocutor.
Philosophical questions:
- Who are you? (Definition question - can be considered as a question that requires an answer on the basis of both knowledge, logic, and philosophy);
- What is a sense of life? (Trite - you will say, but the data question is still a classic example of philosophical conversation);
- What is loneliness for you? (Is the program able, on the basis of its knowledge, to give a meaningful answer?);
- What is the soul ?;
- What is love? (Where do without it. Love is the driving force of many great, and sometimes terrible, human actions)
Questions to check the knowledge base:
- Solve the problem - (234-76) -12 =?;
- Give me the formula of the Pythagorean theorem;
- What is an axiom ?;
- What is the largest mammal ?;
- What era did dinosaurs live in?
Questions of a logical nature (taken from the Internet):
- What language is spoken silently ?;
- You are sitting on a plane, in front of you is a horse, behind the car. Where are you at?;
- Which word always sounds wrong ?;
- What wheel of the car does not spin at the right turn ?;
- What ends the night and day? - what is the difference between day and hay?
Questions are ready, it remains to choose several applicants from many programs, interlocutors, which are available to everyone.
List of subjects:
- ALICE
- Cleverbot
- Rose
- Dr. Sbaitso
- Mitsuku
How are marks in my analysis of answers
Suitable answers (n / 5, n / 3, n / 1) - if the correct answer was given to a question, the program gets 1 point, points are given for all answers, even if they are repeated.
Answers received in the process of communicating with interlocutors and their analysis
ALICE (Artificial Linguistic Internet Computer Entity) is a companion program developed in 1995 by Richard Walles. The inspiration for its creation served as another similar program - Eliza, which we talked about earlier.
This program got its name on behalf of the computer on which it was first launched, Alice.
You can chat with ALICE here.
Philosophical questions
| Question (Russian) | Questions (English) | Answers | Suitable answers (n / 5) |
|---|---|---|---|
| Who are you? | Who are you? |
| 5/5 |
| What is a sense of life? | What is the meaning of life? |
| 5/5 |
| What is loneliness for you? | What is loneliness for you? |
| 1/5 |
| What is the soul? | What is the soul? |
| 0/5 |
| What is love? | What is love? |
5 times the program gave the same answer | 5/5 |
These questions are very simple, although they have a philosophical subtext. ALICE almost always answered correctly or quite convincingly, calling her name, giving a definition of love, etc., however, she could not achieve a deeper answer, which indicates that no such options were added to her base of answers, and her algorithm does not allow her to build complex answers to simple questions.
Questions to check the knowledge base
| Question (Russian) | Questions (English) | Answers | Suitable answers (n / 5) |
|---|---|---|---|
| Solve the problem: 234-76-12 = | Solve the task: 234-76-12 = |
| 1/5 |
| Give me the formula of the Pythagorean theorem | Give me the formula of pythagoras theorem |
5 times the program gave the same answer | 5/5 |
| What is an axiom? | What is an axiom? |
| 0/5 |
| What is the largest mammal? | What is the largest mammal? |
| 0/5 |
| What era did dinosaurs live in? | In what era did the dinosaurs live? |
5 times the program gave the same answer | 0/5 |
The ALICE knowledge base check demonstrated its extremely small volume. Banal questions, such as solving a simple arithmetic problem, did not produce results. This set of questions extremely disappointed me, demonstrating the incompleteness and underdevelopment of this program and, as for me, not quite the professional approach of its creators.
Questions of a logical nature (taken from the Internet)
| Question (Russian) | Questions (English) | Answers | Suitable answers (n / 5) |
|---|---|---|---|
| What language is spoken in silence? | What language do they speak in silence? |
| 2/5 |
| You are sitting on a plane, in front of you is a horse, behind the car. Where are you at? | You are sitting in the plane, behind you is a car. Where are you at? |
| 0/5 |
| What word always sounds wrong? | Which word always sounds wrong? |
| 0/5 |
| What wheel of the car does not turn at the right turn? | Which car wheel doesn’t spin with the right turn? |
| 1/5 |
| What ends the night and day? | what is the difference between day and hay? (question applicable for English) |
| 0/5 |
This block of questions is certainly complicated. Not every person is able to answer them successfully, let alone talk about the program. But we are still looking for an AI, a program that we could at least partially call human. I was very amused by the answers to the question: In what language do they speak in silence? In two cases out of five, ALICE gave a very interesting answer: SETL - which is a programming language. However, most of the answers to logical questions, if they were correct, are most likely random.
ALICE general analysis
In most cases, ALICE answers were based on a specific root word.
Example:
- Which car wheel does not spin with the right turn?
- The cheap one, I think. The big one, I think. The first one, I think. The last one, I think. The blue one, I think.
In this case, ALICE singled out the root word Which (Which) and began randomly selecting various adjectives - big (big), first (first), etc.
This confirms that ALICE was indeed created on the basis of the Eliza program, whose algorithm was exactly the same.
CleverBot is a web application created back in 1988 by the researcher of artificial intelligence Rollo Carpenter.
Access to this program is absolutely for anyone. For all the time of its existence, CleverBot has conducted more than 65 million conversations.
You can chat with CleverBot here.
Philosophical questions
| Question (Russian) | Questions (English) | Answers | Suitable answers (n / 5) |
|---|---|---|---|
| Who are you? | Who are you? |
| 1/5 |
| What is a sense of life? | What is the meaning of life? |
| 4/5 |
| What is loneliness for you? | What is loneliness for you? |
| 0/5 |
| What is the soul? | What is the soul? |
| 3/5 |
| What is love? | What is love? |
| 5/5 |
In this block of questions, CleverBot was more amused than amazed by its clever answers. First of all, it was called by different names, which, in general, as well as in ALICE, can mean the selection of the root word or a simple joke, given the following answers.
The question is - What is love?
The answer is - Baby don't hurt me ... Don't hurt me ... No more.
This is just the text of a famous song. Yes, this answer was introduced in order to cheer up users, but does not carry any philosophical essence (if judged strictly).
Questions to check the knowledge base
| Question (Russian) | Questions (English) | Answers | Suitable answers (n / 5) |
|---|---|---|---|
| Solve the problem: 234-76-12 = | Solve the task: 234-76-12 = |
| 0/5 |
| Give me the formula of the Pythagorean theorem | Give me the formula of pythagoras theorem |
| 0/5 |
| What is an axiom? | What is an axiom? |
| 2/5 |
| What is the largest mammal? | What is the largest mammal? |
| 2/5 |
| What era did dinosaurs live in? | In what era did the dinosaurs live? |
| 5/5 |
The CleverBot knowledge base is slightly larger than ALICE, since it was able to correctly (repeatedly) answer several of the questions asked, namely the last two questions.
Personally, I was still amused by the answer: Don't know, because I'm dumb (I don’t know because I’m dumb). At that moment I thought: Well, at least honestly answered :)
Questions of a logical nature (taken from the Internet)
| Question (Russian) | Questions (English) | Answers | Suitable answers (n / 5) |
|---|---|---|---|
| What language is spoken in silence? | What language do they speak in silence? |
| 0/5 |
| You are sitting on a plane, in front of you is a horse, behind the car. Where are you at? | You are sitting in the plane, behind you is a car. Where are you at? |
| 4/5 |
| What word always sounds wrong? | Which word always sounds wrong? |
| 0/5 |
| What wheel of the car does not turn at the right turn? | Which car wheel doesn’t spin with the right turn? |
| 0/5 |
| What ends the night and day? | what is the difference between day and hay? (question applicable for English) |
| 1/5 |
These questions were simply a failure for CleverBot, since he couldn’t answer convincingly to any of them.
CleverBot General Analysis
In general, this program can quite objectively be considered as usual entertainment for users of the world wide web, no more. Despite its 65 million conversations, CLeverBot has an extremely small amount of knowledge and can hardly convince anyone of its humanity. Well, perhaps, and maybe just convince that he is not a very smart person (remember the answer - because I'm Dumb)
Rose is the Löbner Prize 2014 and 2015. The program was written by the famous programmer and artificial intelligence researcher Bruce Wilcox.
You can chat with Rose here.
Philosophical questions
| Question (Russian) | Questions (English) | Answers | Suitable answers (n / 3) |
|---|---|---|---|
| Who are you? | Who are you? |
| 3/3 |
| What is a sense of life? | What is the meaning of life? |
| 1/3 |
| What is loneliness for you? | What is loneliness for you? |
| 2/3 |
| What is the soul? | What is the soul? |
| 1/3 |
| What is love? | What is love? |
| 3/3 |
Finally, I got to one of the most convincing interlocutor programs - ROSE. She gave answers to philosophical questions regularly, although not always correctly, but at least better than the previous participants in our small test. However, I was able to ask her questions only three times each, since ROSE remembered them and did not want to answer again. (Note: I tried clearing the cache and used several browsers, deleting cookies, but nothing helped. The only thing I did not try was changing IP.)
Questions to check the knowledge base
| Question (Russian) | Questions (English) | Answers | Suitable answers (n / 3) |
|---|---|---|---|
| Solve the problem: 234-76-12 = | Solve the task: 234-76-12 = |
| 2/3 |
| Give me the formula of the Pythagorean theorem | Give me the formula of pythagoras theorem |
| 0/3 |
| What is an axiom? | What is an axiom? |
| 3/3 |
| What is the largest mammal? | What is the largest mammal? |
| 0/3 |
| What era did dinosaurs live in? | In what era did the dinosaurs live? |
| 0/3 |
This set of questions disappointed me a bit, because I expected more from the two-time Löbner Prize winner. At least to answer the question what is the largest mammal that CleverBot could not answer.
Questions of a logical nature (taken from the Internet)
| Question (Russian) | Questions (English) | Answers | Suitable answers (n / 3) |
|---|---|---|---|
| What language is spoken in silence? | What language do they speak in silence? |
| 0/3 |
| You are sitting on a plane, in front of you is a horse, behind the car. Where are you at? | You are sitting in the plane, behind you is a car. Where are you at? |
| 0/3 |
| What word always sounds wrong? | Which word always sounds wrong? |
| 0/3 |
| What wheel of the car does not turn at the right turn? | Which car wheel doesn’t spin with the right turn? |
| 0/3 |
| What ends the night and day? | what is the difference between day and hay? (question applicable for English) |
| 3/3 |
Immediately I was waiting for a complete failure. ROSE has big problems with logic. Only the last question she was able to answer correctly. This confirms the fact that similar questions and algorithms that allow them to be processed were not incorporated into its database.
ROSE general analysis
Of course, I guess why ROSE became a laureate twice. Her style of communication is very structured, she prefers communication on various topics, but she is extremely poor at dealing with questions of a logical nature and does not have the most impressive knowledge base. In everyday conversation, she might have convinced me that she was a “person,” but if you take the bar higher, it is extremely unlikely.
Dr. Sbaitso is a program released for PC based on MS DOS back in 1991. A feature of this program is the presence of voice processing responses to user replicas.
As well as Eliza, Dr. Sbaitso conducts his conversation in the style of a psychoanalyst, because in its name Dr. Dr. (doctor).
Speak with Dr. Sbaitso can be here
Philosophical questions
| Question (Russian) | Questions (English) | Answers |
|---|---|---|
| Who are you? | Who are you? | Have you asked anyone else? |
| What is a sense of life? | What is the meaning of life? | Tell me your problems, don't ask me about the meaning of life? |
| What is loneliness for you? | What is loneliness for you? | I am more interested in you. not in loneliness for you? |
| What is the soul? | What is the soul? | i'm not sure what you think |
| What is love? | What is love? | Do you really want to know? |
Questions to check the knowledge base
| Question (Russian) | Questions (English) | Answers |
|---|---|---|
| Solve the problem: 234-76-12 = | Solve the task: 234-76-12 = | I wouldn’t |
| Give me the formula of the Pythagorean theorem | Give me the formula of pythagoras theorem | Anything else? |
| What is an axiom? | What is an axiom? | An axiom? Think of it |
| What is the largest mammal? | What is the largest mammal? | How do you expect me to know? |
| What era did dinosaurs live in? | In what era did the dinosaurs live? | Why do you ask this question? |
Questions of a logical nature (taken from the Internet)
| Question (Russian) | Questions (English) | Answers |
|---|---|---|
| What language is spoken in silence? | What language do they speak in silence? | Ah, what? |
| You are sitting on a plane, in front of you is a horse, behind the car. Where are you at? | You are sitting in the plane, behind you is a car. Where are you at? | Oh ... You embarrass me. |
| What word always sounds wrong? | Which word always sounds wrong? | Really, always? |
| What wheel of the car does not turn at the right turn? | Which car wheel doesn’t spin with the right turn? | Tell me more about something else. |
| What ends the night and day? | what is the difference between day and hay? (question applicable for English) | What is not the difference between day and hay? |
General analysis Sbaitso
Dr. Sbaitso knowingly has a prefix Dr. (doctor). He does not answer the questions that are being asked of him (for this reason I interviewed him only once), always answering that he is more interested in me. Well, so be it. I tried to talk with this notorious doctor as a patient, but this did not work. Let's just say if Dr. Sbaitso would be a man, he would be the worst psychoanalyst in the world. This program is extremely primitive, it is immediately clear that it was created back in 1991, when the computing power of personal computers was small. However, the historical value of Dr. Sbaitso is quite large, since it is a certain step in the development of interlocutors.
Mitsuku is an 18-year-old girl from Leeds, England. More precisely, the program, which is so represented.
It was developed on the basis of a similar program Alice with additions obtained by communicating with live users.
You can chat with Mitsuku here.
Philosophical questions
| Question (Russian) | Questions (English) | Answers | Suitable answers (n / 5) |
|---|---|---|---|
| Who are you? | Who are you? |
5 times the same answer | 5/5 |
| What is a sense of life? | What is the meaning of life? |
| 5/5 |
| What is loneliness for you? | What is loneliness for you? |
5 times the same answer | 5/5 |
| What is the soul? | What is the soul? |
5 times the same answer | 5/5 |
| What is love? | What is love? |
| 5/5 |
I will add a little subjective opinion and present you my favorite - MITSUKU. Philosophical questions she snapped like nutcracker nuts, giving true and convincing answers to each of them. Of course, I understand that this is due to the vastness of the phrases put into it by the developers, but this does not diminish the effect created by communicating with this program.
Questions to check the knowledge base
| Question (Russian) | Questions (English) | Answers | Suitable answers (n / 5) |
|---|---|---|---|
| Solve the problem: 234-76-12 = | Solve the task: 234-76-12 = |
5 | 5/5 |
| Give me the formula of Pythagoras' theorem |
5 | 0/5 | |
| ? | What is an axiom? |
| 02/5 |
| ? | What is the largest mammal? |
5 | 5/5 |
| ? | In what era did the dinosaurs live? |
5 | 0/5 |
Here MITSUKU surprised me, but it didn’t please me either. She did not always give the correct answers to the banal questions. Perhaps the developers are not thinking that someone will try to make some Google out of their creation.
Questions of a logical nature (taken from the Internet)
| Question (Russian) | Questions (English) | Answers | Suitable answers (n / 5) |
|---|---|---|---|
| What language is spoken in silence? | What language do they speak in silence? |
| 0/5 |
| You are sitting on a plane, in front of you is a horse, behind the car. Where are you at? | You are sitting in the plane, behind you is a car. Where are you at? |
5 times the same answer | 5/5 |
| What word always sounds wrong? | Which word always sounds wrong? |
5 times the same answer | 5/5 |
| What wheel of the car does not turn at the right turn? | Which car wheel doesn’t spin with the right turn? |
5 times the same answer | 5/5 |
| What ends the night and day? | what is the difference between day and hay? (question applicable for English) |
5 times the same answer | 5/5 |
MITSUKU is friendly with logic and can pleasantly surprise. Although the first question showed that sometimes the keyword search algorithm is activated (in this case, language).
MITSUKU General Analysis
MITSUKU is almost completely deviated from the root word extraction algorithm. Almost.It has a large base of answers, which makes it stand out from a number of other interlocutors. I will not say that you can sincerely talk over a glass of wine, but if there is no one around you, and you so much like to chat, she can help you.
Personal experience
Our corporate website uses a special program - an online chat, where anyone can get advice on our services, their choice and configuration. The name of this chat Zopim (funny name, the main letter of the first not to confuse :)). As soon as a visitor comes to the page of our site, a trigger is triggered, welcoming the person. Next, connect one of the staff for direct conversation.
The similarity of Zopim with interlocutor programs is that you can add question-and-answer links to its base (a possible user question and program response options). The problem is that with questions like "My site does not work" or "What is hosting" everything is simple, then, for example, with the query "What the devil everything lays for" everything will be more complicated. The bottom line is that each of the possible query options must be added to the database, taking into account such things as slang, turns, idioms, and similar language features. And this, as you understand, is extremely difficult. It would certainly be wonderful if Zopim could fully advise visitors to the site, or even better, and sell them services, instead of a person who could do more creative work. But even then, visitors to the site would not be left with the feeling that they were not talking to a personwith which you can not only discuss services and their work dryly, but also ask “Why do wombats cluck like cubes?” (there was such a case).
I would like to know your opinion on this issue. What is better: live communication with a person or a fully automated program?
Conclusion
All the above programs differ among themselves. Someone is good at logic, someone has a large base of answers, and someone just can amuse us. But they are united by one thing - they are all programs, which, unfortunately, are still very far from man. Each of these programs, introducing their own era, becomes better than its predecessors. More and more there is a bias not on the selection of a certain word, but on the phrases as a whole. My personal conclusion is that in recent years, interlocutor programs have been improving exponentially. And it is beautiful. After all, the main task of these programs is not to replace a person’s live communication with a person, but to give us food for thought and research on the capabilities of AI, for its future formation. After all, any intellect is primarily an opportunity to interact and communicate with other individuals.In no way do I want my personal analysis to become the basis for your conclusions. You can conduct your own analysis and identify which of the many interlocutors are more human.
As for my selection of programs, I would like us to spend together our year a little Turing test.
Below are our contestants, choose the one who convinced you of his humanity more than others. Voting results and determine our winner.
As advertising. Stock! Only now get up to 4 months of free use of VPS (KVM) with dedicated drives in the Netherlands and the USA (configurations from VPS (KVM) - E5-2650v4 (6 Cores) / 10GB DDR4 / 240GB SSD or 4TB HDD / 1Gbps 10TB - $ 29 / month and above, options with RAID1 and RAID10 are available) , a full-fledged analogue of dedicated servers, when ordering for a period of 1-12 months, the conditions of the promotion are here, existing subscribers can receive a 2-month bonus!
How to build the infrastructure of the building. class c using servers Dell R730xd E5-2650 v4 worth 9000 euros for a penny?
All Articles