TODOs, WIP, Ideas....

stuff.md

Random urls and utils

• https://github.com/polygoat/natex-py <- regex for postags, simple and fast
• links with intent datasets that might be useful
  • https://github.com/jianguoz/Few-Shot-Intent-Detection
  • https://github.com/kumar-shridhar/Know-Your-Intent

TODO

OCA

https://github.com/OpenVoiceOS/ovos-config-assistant

• extend to also use ovos_config package
  • https://github.com/OpenVoiceOS/ovos-config
• make a UI using PyWebIO similar to local backend UI
  • https://pywebio.readthedocs.io/en/v1.2.2/guide.html
  • https://github.com/OpenVoiceOS/ovos-personal-backend-ui
• multiple-core support
  • installed in same device, ovos-core is a dependency and always available
  • manage multiple cores, native neon support (auto config button)
  • print and manage all ovos.conf + mycroft.conf aspects per core
  • allow mix and match, eg, neon-speech and all other services stock ovos (?)
• OPM support, populate options based on installed plugins
  • dropdown to select saved configs
  • prepopulated from OPM interface per lang
  • allow use to save their own configs
  • form based on template (TODO, needs work OPM side)
• rich intent plugin support
  • pre train models
  • benchmarks
  • match all installed skills and suggest best config
• rich wake word model support
  • vosk plugin auto config with just a string
  • pocketsphinx auto config, threshold testing interface
  • import datasets
    • precise community
    • local backend
  • export datasets
    • download a dataset ready for precise training
  • auto generate snowboy ww models
    • configurable trainer url
    • try several combos of 3 samples, benchmark all models, pick best
    • allow resuming (remember previous used combinations and benchmarks)

New plugins

coref

• https://github.com/Sean-Blank/AMRcoref
• https://github.com/IreneZihuiLi/VG-AMRCoref
• https://github.com/bjascob/amr_coref

intents

• simpler ngram count with 0 deps baseline - https://github.com/ivankunyankin/intent_suggestions
• nltk baseline - https://github.com/poojithamiryala/Intent-Classification
• scikit multi model classifier - https://github.com/AmateurAcademic/interview-code-examples
• scikit rules + model hybrid - https://github.com/aitrek/intent_classifier
• new approach to try out - https://github.com/bjascob/amrlib
• regex + postag baseline, can i come up with automated rules ? - https://github.com/polygoat/natex-py
  • posdatious
• rest api based tensorflow/spacy engine - https://github.com/anuragmishra1/alter-nlu

postag

• stanza / natex-py - can be provided together with the intent plugin described above

Ideas

New ovos pipelines

OOVSkills

• out-of-vocabulary intents skill class - OOVSkills
• triggered before common_query framework
• match an intent using something like https://github.com/GT4SD/zberta
  • this gives us an intent classification without a registred handler
  • "handle this question" becomes "handle this intent somehow"
  • OOVSkills can use this info for a richer common_query experience
• send the intent_tag + utterance to OOVSkills

Tech demos

• FM output
  • broadcast OVOS as a radio station
    • no speakers connected to pi
    • any old Radio for playback
      • integrate with old cars
    • broadcast to multiple devices
    • automated radio station fun, live interaction with AI?
  • https://github.com/F5OEO/rpitx
• VHF output via composite
  • broadcast OVOS as a TV station
    • any old TV can be a display
    • broadcast to multiple devices
    • automated tv station fun, live interaction with AI?
  • https://github.com/ssshake/pi-uhf-tv-station
• FPS game
  • dedicated embbeded ovos-core as a lib
  • you talk to the player character only / not part of the game world
  • ask about stats, tips, surroundings...
  • https://github.com/MaxwellSalmon/DUGA
• RPG game
  • dedicated embbeded ovos-core as a lib
    • hivemind like integration for multiple users (in-game NPC)
    • shared_skills + skills per NPC, TTS per NPC
  • you are the player character / part of the game world
  • each NPC connected to a ovos-core/hivemind instance
• Voice Frotz
  • wrapper around pyfrotz for ovos
  • integrate with OCP for games category
  • https://github.com/OpenJarbas/pyFrotz
• Voice First Interactive Fiction
  • resume dev on https://github.com/JarbasAl/TNaLaGmes game engine
    • more inbuilt objects / intents
  • make a few prototypes
    • oregon trail port (WIP) <- simple game engine loop
    • interactive world with objects <- rooms / map / objects base interactive fiction engine