With modern CPU’s supposedly shipping with ‘AI cores’: How long do you think it will take for a proper opensource, privacy respecting productivity tools(Something like whatever M$ copilot is supposed to be?) to be available?

Personally, i would love to see something like ‘Passive’ OCR integrated with the display server: the ability to pause any video and just select whatever text(even handwritten) there is naturally like it was a text document without any additional hassle will be really useful
Also useful in circumventing any blocks certain websites put on articles to prevent text from being copied

Or an AI grammar checker running natively for LibreOffice.

What are some AI tools you think should be developed for desktop Linux?

  • @[email protected]OP
    link
    fedilink
    1411 months ago

    I was thinking more along the lines of something that is application agnostic i.e If it is on your display, the tool can grab it

    • qaz
      link
      3
      edit-2
      11 months ago

      I personally have a script that allows me to press a keybinding and then select some part of the display after which it copies the contents to my clipboard as text. Are you looking for something like that?

      Here it is, it should work on both Wayland and X11, but does require having spectacle and tesseract installed.

      #!/bin/bash
      
      # Written by u/qaz licensed under GPL3
      
      if ! which spectacle > /dev/null; then
          kdialog --sorry "spectacle, the required screenshotting tool, is not installed."
          exit 1
      fi
      
      if ! which tesseract > /dev/null; then
          kdialog --sorry "tesseract, the required OCR package, is not installed."
          exit 1
      fi
      
      screenshot_tempfile=$(mktemp)
      spectacle -brn -o $screenshot_tempfile
      text_tempfile=$(mktemp)
      tesseract $screenshot_tempfile $text_tempfile
      rm $screenshot_tempfile
      
      result_text=$(cat $text_tempfile.txt)
      rm $text_tempfile.txt
      
      # Copy to either X11 or Wayland clipboard
      echo $result_text | xclip -selection clipboard
      wl-copy "$result_text"
      
      notify-send -u low -t 2500 "Copied text to clipboard" "$result_text"