Call user pre_filter_cb before internal decimation of YouTube items in order to make complete items to be available.

Author: GeneralYadoc

README.md

@@ -147,7 +147,7 @@ Message broker between YouTube chat stream and ChatGPT.
     | interval_sec | Interval of ChatGPT API call | 20.0 \[sec\] | 
 ### Notice
 - Please refer [pytchat README](https://github.com/taizan-hokuto/pytchat) to know the type of YouTube Chat item used by get_item_cb, pre_filter_cb and post filter_cb.
-- Stamps in a message and messages consisted by stamps only are removed defaultly even if user doesn't set pre_filter_cb.
+- Emoticons in a message and messages consisted by emoticons only are removed defaultly even if user doesn't set pre_filter_cb.
 - Default value of interval_sec is 20.0, since free user of OpenAI API can get only 3 completions per minitue.
 - The system role given by user remains ever as the oldest sentence of current context even if the number of messages is reached to the maximum, so ChatGPT doesn't forgot the role while current cunversation.
 
@@ -182,6 +182,7 @@ And other [threading.Thread](https://docs.python.org/3/library/threading.html) p
 - pre putting queue filter.
 - YouTube chat item is thrown as an argument.
 - You can edit YouTube chat items before putting internal queue.
+- <b>If you want to get Complete items from YouTube, please implement this callback, since emoticons in a message and messages consisted by emoticons only are already removed from the items gotten in get_item_cb.</b> 
 - It's required that edited chat item is returned.
 - You can avoid putting internal queue by returning None.
 ### post_filter_cb

setup.py

@@ -12,7 +12,7 @@ def _requires_from_file(filename):
 
 setup(
     name="chatai-stream",
-    version="0.0.1",
+    version="0.0.2",
     license="MIT",
     description="ChatGPT reacts YouTube chat messages.",
     author="General Yadoc",
@@ -34,4 +34,4 @@ def _requires_from_file(filename):
     install_requires=_requires_from_file('requirements.txt'),
     setup_requires=["pytest-runner"],
     tests_require=["pytest", "pytest-cov"]
-)
+)

src/ChatAIStream.py

@@ -17,10 +17,10 @@ class params():
 class ChatAIStream(threading.Thread):
   def my_pre_filter_cb(self, c):
     prefiltered_c = c
-    prefiltered_c.message = re.sub(r':[^:]+:', ".", prefiltered_c.message)
-    prefiltered_c.message = re.sub(r'^[\.]+', "", prefiltered_c.message)
     if prefiltered_c and self.pre_filter_cb:
       prefiltered_c = self.pre_filter_cb(prefiltered_c)
+    prefiltered_c.message = re.sub(r':[^:]+:', ".", prefiltered_c.message)
+    prefiltered_c.message = re.sub(r'^[\.]+', "", prefiltered_c.message)
     return None if prefiltered_c.message == "" else prefiltered_c
 
   def ask_stream_message_to_ai(self, c):

src/__init__.py

@@ -1,3 +1,3 @@
 from .ChatAIStream import *
 
-__version__ = '0.0.1'
+__version__ = '0.0.2'