Upgraded ChatBot #161

lunayach · 2018-07-26T17:00:45Z

Description

Shifted to new more robust and scalable ChatBot built on top of Rasa Core using Rasa NLU as processing pipeline.

Fixes #132, #133

Type of Change:

Code
Outreach
Documentation
This change requires a documentation update (software upgrade on readme file)
New feature (non-breaking change which adds functionality pre-approved by mentors)

How Has This Been Tested?

Evaluated the model using cross-validation.
Precision, f1-score, Confusion matrix etc. were recorded.

Checklist:

My PR follows the style guidelines of this project
I have performed a self-review of my own code or materials
I have commented my code or provided relevant documentation, particularly in hard-to-understand areas
I have made corresponding changes to the documentation
Any dependent changes have been merged

Code/Quality Assurance Only

My changes generate no new warnings
New and existing unit tests pass locally with my changes
Any dependent changes have been published in downstream modules

Raxerz · 2018-07-27T19:39:31Z

ChatBot/Makefile

@@ -0,0 +1,23 @@
+run:


Will this work for both python 2 and 3?

I think we should Integrate it as part of travis build. Opinions @Raxerz @paavininanda @Buddhiprabha

@shreyans29 what purpose shall it serve?
I have created this make file just to map larger python commands to shorter make commands.
i.e. instead of python bot.py run, you can call make run

@Raxerz it supports both Python 2 and 3.

okay.. about version, rasa has support for both, but you must have chosen one of those and moved ahead with it right? APIs for python 2 and python 3 are different. I doubt we can build this code with both.

@shreyans29 I had used Python 3. And accordingly recommended this in the Documentation.

yes.. I am saying that this code won't work with python 2. If you used python 3 which is a nice decision, everyone contributing in future will have to use python 3.

Okay! Got it.

Raxerz · 2018-07-27T19:46:19Z

ChatBot/domain.yml

+  utter_ask_name:
+    - "What's your name?"
+  utter_ask_gender:
+    - "About you, male or female?"


I guess since we have the option of a third gender then we may have to ask this differently like "May I know your gender?"

Raxerz · 2018-07-27T19:47:28Z

ChatBot/models/current/dialogue/domain.json

+    "prev_utter_ask_age",
+    "prev_check_age"
+  ]
+}


Raxerz · 2018-07-27T19:48:16Z

ChatBot/models/current/dialogue/policy_1_KerasPolicy/featurizer.json

@@ -0,0 +1 @@
+{"py/object": "rasa_core.featurizers.MaxHistoryTrackerFeaturizer", "max_history": 3, "remove_duplicates": true, "state_featurizer": {"py/object": "rasa_core.featurizers.BinarySingleStateFeaturizer", "input_state_map": {"entity_age": 16, "entity_medicine": 15, "intent_Female": 13, "intent_Male": 12, "intent_affirm": 10, "intent_botPlace": 4, "intent_deny": 11, "intent_gender": 9, "intent_goodbye": 2, "intent_greet": 0, "intent_identity": 3, "intent_informThird": 14, "intent_intro": 6, "intent_medicines": 7, "intent_prevent": 5, "intent_safeMedicine": 8, "intent_thankyou": 1, "prev_action_listen": 20, "prev_action_patient_information": 34, "prev_action_restart": 21, "prev_action_suggest_normal": 36, "prev_action_suggest_pregnant": 35, "prev_check_age": 38, "prev_utter_ask_age": 37, "prev_utter_ask_gender": 32, "prev_utter_ask_name": 31, "prev_utter_ask_pregnant": 33, "prev_utter_default": 22, "prev_utter_goodbye": 24, "prev_utter_greet": 23, "prev_utter_identity": 26, "prev_utter_intro": 29, "prev_utter_medicines": 30, "prev_utter_place": 27, "prev_utter_prevent": 28, "prev_utter_youarewelcome": 25, "slot_age_0": 17, "slot_matches_0": 18, "slot_requested_slot_0": 19}, "num_features": 39, "slot_feature_len": 3, "user_feature_len": 17}, "use_intent_probabilities": false}


new line at the end of the file

Raxerz · 2018-07-27T19:48:28Z

ChatBot/models/current/dialogue/policy_1_KerasPolicy/keras_arch.json

@@ -0,0 +1 @@
+{"class_name": "Sequential", "config": [{"class_name": "Masking", "config": {"name": "masking_1", "trainable": true, "batch_input_shape": [null, 3, 39], "dtype": "float32", "mask_value": -1}}, {"class_name": "LSTM", "config": {"name": "lstm_1", "trainable": true, "return_sequences": false, "return_state": false, "go_backwards": false, "stateful": false, "unroll": false, "units": 32, "activation": "tanh", "recurrent_activation": "hard_sigmoid", "use_bias": true, "kernel_initializer": {"class_name": "VarianceScaling", "config": {"scale": 1.0, "mode": "fan_avg", "distribution": "uniform", "seed": null}}, "recurrent_initializer": {"class_name": "Orthogonal", "config": {"gain": 1.0, "seed": null}}, "bias_initializer": {"class_name": "Zeros", "config": {}}, "unit_forget_bias": true, "kernel_regularizer": null, "recurrent_regularizer": null, "bias_regularizer": null, "activity_regularizer": null, "kernel_constraint": null, "recurrent_constraint": null, "bias_constraint": null, "dropout": 0.2, "recurrent_dropout": 0.0, "implementation": 1}}, {"class_name": "Dense", "config": {"name": "dense_1", "trainable": true, "batch_input_shape": [null, 32], "dtype": "float32", "units": 19, "activation": "linear", "use_bias": true, "kernel_initializer": {"class_name": "VarianceScaling", "config": {"scale": 1.0, "mode": "fan_avg", "distribution": "uniform", "seed": null}}, "bias_initializer": {"class_name": "Zeros", "config": {}}, "kernel_regularizer": null, "bias_regularizer": null, "activity_regularizer": null, "kernel_constraint": null, "bias_constraint": null}}, {"class_name": "Activation", "config": {"name": "activation_1", "trainable": true, "activation": "softmax"}}], "keras_version": "2.2.0", "backend": "tensorflow"}


Raxerz · 2018-07-27T19:48:35Z

ChatBot/models/current/dialogue/policy_1_KerasPolicy/keras_policy.json

@@ -0,0 +1,5 @@
+{


Raxerz · 2018-07-27T19:48:53Z

ChatBot/models/current/dialogue/policy_metadata.json

+    "rasa_core.policies.memoization.MemoizationPolicy",
+    "rasa_core.policies.keras_policy.KerasPolicy"
+  ]
+}


Raxerz · 2018-07-27T19:49:43Z

ChatBot/models/nlu/default/current/metadata.json

+    "training_data": "training_data.json",
+    "trained_at": "20180725-005152",
+    "rasa_nlu_version": "0.12.0"
+}


Raxerz · 2018-07-27T19:49:53Z

ChatBot/nlu_model_config.yml

+#- name: "ner_synonyms"
+#- name: "intent_entity_featurizer_regex"
+#- name: "intent_featurizer_mitie"
+#- name: "intent_classifier_sklearn"


Raxerz · 2018-07-27T19:50:41Z

ChatBot/nlu_model_config.yml

+
+
+
+#language: "en"


are all these comments required?

Raxerz · 2018-07-27T19:51:46Z

ChatBot/test-data.json

+      {
+        "intent": "botPlace",
+        "text": "Where you?"
+      },      {


the opening braces for this block should be on a new line

shreyans29 · 2018-08-09T07:42:24Z

ChatBot/data/nlu_data/greet.md

+- Hola
+- Ola
+
+


two new lines added..

shreyans29 · 2018-08-09T07:42:43Z

ChatBot/data/nlu_data/informThird.md

+ - why specify?
+ - will not tell
+
+


two newlines in so many files..

shreyans29 · 2018-08-09T07:45:17Z

src/app/meds-n-labels/activity-3/activity-3.component.ts

+        this.messages.push({message: {text: sentMessage}, status: 'sent-message'});
+        if (localStorage.getItem(DoctorchatComponent._localStorageKey)) {
+          this._botService.getIntent(sentMessage).subscribe(intent => {
+            this._botService.getResponse(sentMessage).subscribe(text => {


Is there a default timeout.. or some error handling done here ?

Ya, done in the service code.

Raxerz · 2018-08-09T18:23:38Z

@lunayach
I am getting the following error:

ERROR Error: Cannot find a differ supporting object 'function link() { [native code] }' of type 'link'. NgFor only supports binding to Iterables such as Arrays.
    at NgForOf.push../node_modules/@angular/common/fesm5/common.js.NgForOf.ngOnChanges (common.js:3379)
    at checkAndUpdateDirectiveInline (core.js:10093)
    at checkAndUpdateNodeInline (core.js:11363)
    at checkAndUpdateNode (core.js:11325)
    at debugCheckAndUpdateNode (core.js:11962)
    at debugCheckDirectivesFn (core.js:11922)
    at Object.View_DoctorchatComponent_3._co [as updateDirectives] (DoctorchatComponent.html:10)
    at Object.debugUpdateDirectives [as updateDirectives] (core.js:11914)
    at checkAndUpdateView (core.js:11307)

Am I missing something here? Can you please look into it?

lunayach · 2018-08-10T07:48:36Z

@Raxerz did you start the Bot server after installing all the dependencies.

Raxerz · 2018-08-10T17:36:03Z

@lunayach fix the conflict and can you share the steps to set up the bot server

lunayach · 2018-08-10T19:50:23Z

@Raxerz you may follow the steps given in the beginning of the ChatBot wiki, https://github.com/systers/PC-Prep-Kit/wiki/ChatBot-Documentation
And when exactly this error comes? Like, during querying the bot? etc.

lunayach · 2018-08-10T20:39:53Z

Addressed comments.

shreyans29 · 2018-08-11T05:58:07Z

ChatBot/models/current/dialogue/domain.json

+    "prev_action_check_medicine_normal",
+    "prev_action_check_medicine_pregnant"
+  ]
+}


This is an autogenerated model file.

shreyans29 · 2018-08-11T05:58:49Z

ChatBot/models/dialogue/domain.json

+    "prev_action_check_medicine_normal",
+    "prev_action_check_medicine_pregnant"
+  ]
+}


are these autogenerated.. if not add a new line.

This is an autogenerated model file.

shreyans29

Just minor new line issues. You have to confirm if the files are autogenerated.

shreyans29 · 2018-08-11T16:01:26Z

@paavininanda @Raxerz this can also be reviewed and merged.. have alook

paavininanda

Just a small change otherwise looks good.

paavininanda · 2018-08-11T16:05:31Z

ChatBot/data/nlu_data/intro.md

+ - What is this?
+ - Mosquito transmitted diseases
+
+


Extra new line here

paavininanda

@shreyans29 This can be merged now 👍

lunayach force-pushed the ChatBotUpgrade branch from b9956e1 to e48829b Compare July 26, 2018 19:29

systers deleted a comment Jul 26, 2018

lunayach force-pushed the ChatBotUpgrade branch from e48829b to a28249c Compare July 26, 2018 19:44

systers deleted a comment Jul 26, 2018

lunayach force-pushed the ChatBotUpgrade branch from a28249c to c33c6a6 Compare July 26, 2018 19:58

systers deleted a comment Jul 26, 2018

Raxerz reviewed Jul 27, 2018

View reviewed changes

ChatBot/models/current/dialogue/domain.json Outdated

"prev_utter_ask_age",

"prev_check_age"

]

}

Copy link

Raxerz Jul 27, 2018

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

new line

Raxerz reviewed Jul 27, 2018

View reviewed changes

ChatBot/models/current/dialogue/policy_1_KerasPolicy/keras_policy.json

@@ -0,0 +1,5 @@

{

Copy link

Raxerz Jul 27, 2018

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

new line

Raxerz reviewed Jul 27, 2018

View reviewed changes

ChatBot/nlu_model_config.yml Outdated

#language: "en"

Copy link

Raxerz Jul 27, 2018

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

are all these comments required?

Raxerz reviewed Jul 27, 2018

View reviewed changes

ChatBot/test-data.json Outdated

{

"intent": "botPlace",

"text": "Where you?"

}, {

Copy link

Raxerz Jul 27, 2018

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the opening braces for this block should be on a new line

shreyans29 reviewed Aug 9, 2018

View reviewed changes

ChatBot/data/nlu_data/greet.md Outdated

- Hola

- Ola

Copy link

shreyans29 Aug 9, 2018

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

two new lines added..

shreyans29 reviewed Aug 9, 2018

View reviewed changes

ChatBot/data/nlu_data/informThird.md Outdated

- why specify?

- will not tell

Copy link

shreyans29 Aug 9, 2018

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

two newlines in so many files..

shreyans29 reviewed Aug 9, 2018

View reviewed changes

lunayach force-pushed the ChatBotUpgrade branch 8 times, most recently from 154b2fd to a281fab Compare August 10, 2018 20:39

shreyans29 reviewed Aug 11, 2018

View reviewed changes

shreyans29 previously approved these changes Aug 11, 2018

View reviewed changes

paavininanda previously approved these changes Aug 11, 2018

View reviewed changes

ChatBot/data/nlu_data/intro.md Outdated

- What is this?

- Mosquito transmitted diseases

Copy link

Member

paavininanda Aug 11, 2018

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Extra new line here

lunayach dismissed stale reviews from paavininanda and shreyans29 via ddd6d53 August 11, 2018 16:26

lunayach force-pushed the ChatBotUpgrade branch from a281fab to ddd6d53 Compare August 11, 2018 16:26

Shifted to RASA NLU + Integrated Bot with Angular Application

27832b4

lunayach force-pushed the ChatBotUpgrade branch from ddd6d53 to 27832b4 Compare August 11, 2018 16:28

paavininanda approved these changes Aug 11, 2018

View reviewed changes

shreyans29 approved these changes Aug 11, 2018

View reviewed changes

shreyans29 merged commit c08f70f into systers:gsoc18 Aug 11, 2018

shreyans29 mentioned this pull request Aug 17, 2018

Integrating Machine Learning model with the current chatbot #133

Closed

7 tasks

		@@ -0,0 +1 @@
		{"py/object": "rasa_core.featurizers.MaxHistoryTrackerFeaturizer", "max_history": 3, "remove_duplicates": true, "state_featurizer": {"py/object": "rasa_core.featurizers.BinarySingleStateFeaturizer", "input_state_map": {"entity_age": 16, "entity_medicine": 15, "intent_Female": 13, "intent_Male": 12, "intent_affirm": 10, "intent_botPlace": 4, "intent_deny": 11, "intent_gender": 9, "intent_goodbye": 2, "intent_greet": 0, "intent_identity": 3, "intent_informThird": 14, "intent_intro": 6, "intent_medicines": 7, "intent_prevent": 5, "intent_safeMedicine": 8, "intent_thankyou": 1, "prev_action_listen": 20, "prev_action_patient_information": 34, "prev_action_restart": 21, "prev_action_suggest_normal": 36, "prev_action_suggest_pregnant": 35, "prev_check_age": 38, "prev_utter_ask_age": 37, "prev_utter_ask_gender": 32, "prev_utter_ask_name": 31, "prev_utter_ask_pregnant": 33, "prev_utter_default": 22, "prev_utter_goodbye": 24, "prev_utter_greet": 23, "prev_utter_identity": 26, "prev_utter_intro": 29, "prev_utter_medicines": 30, "prev_utter_place": 27, "prev_utter_prevent": 28, "prev_utter_youarewelcome": 25, "slot_age_0": 17, "slot_matches_0": 18, "slot_requested_slot_0": 19}, "num_features": 39, "slot_feature_len": 3, "user_feature_len": 17}, "use_intent_probabilities": false}

		@@ -0,0 +1 @@
		{"class_name": "Sequential", "config": [{"class_name": "Masking", "config": {"name": "masking_1", "trainable": true, "batch_input_shape": [null, 3, 39], "dtype": "float32", "mask_value": -1}}, {"class_name": "LSTM", "config": {"name": "lstm_1", "trainable": true, "return_sequences": false, "return_state": false, "go_backwards": false, "stateful": false, "unroll": false, "units": 32, "activation": "tanh", "recurrent_activation": "hard_sigmoid", "use_bias": true, "kernel_initializer": {"class_name": "VarianceScaling", "config": {"scale": 1.0, "mode": "fan_avg", "distribution": "uniform", "seed": null}}, "recurrent_initializer": {"class_name": "Orthogonal", "config": {"gain": 1.0, "seed": null}}, "bias_initializer": {"class_name": "Zeros", "config": {}}, "unit_forget_bias": true, "kernel_regularizer": null, "recurrent_regularizer": null, "bias_regularizer": null, "activity_regularizer": null, "kernel_constraint": null, "recurrent_constraint": null, "bias_constraint": null, "dropout": 0.2, "recurrent_dropout": 0.0, "implementation": 1}}, {"class_name": "Dense", "config": {"name": "dense_1", "trainable": true, "batch_input_shape": [null, 32], "dtype": "float32", "units": 19, "activation": "linear", "use_bias": true, "kernel_initializer": {"class_name": "VarianceScaling", "config": {"scale": 1.0, "mode": "fan_avg", "distribution": "uniform", "seed": null}}, "bias_initializer": {"class_name": "Zeros", "config": {}}, "kernel_regularizer": null, "bias_regularizer": null, "activity_regularizer": null, "kernel_constraint": null, "bias_constraint": null}}, {"class_name": "Activation", "config": {"name": "activation_1", "trainable": true, "activation": "softmax"}}], "keras_version": "2.2.0", "backend": "tensorflow"}

Upgraded ChatBot #161

Upgraded ChatBot #161

Conversation

lunayach commented Jul 26, 2018 • edited Loading

Description

Type of Change:

How Has This Been Tested?

Checklist:

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

lunayach Jul 30, 2018 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Raxerz commented Aug 9, 2018

lunayach commented Aug 10, 2018

Raxerz commented Aug 10, 2018

lunayach commented Aug 10, 2018

lunayach commented Aug 10, 2018

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

shreyans29 left a comment

Choose a reason for hiding this comment

shreyans29 commented Aug 11, 2018

paavininanda left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

paavininanda left a comment

Choose a reason for hiding this comment

lunayach commented Jul 26, 2018 •

edited

Loading

lunayach Jul 30, 2018 •

edited

Loading