cape-dict cuts off after certain amount of words from wordlist on a low resource device

[573]

First off I'm not yet adept enough to know where to start debugging this.

I have a large list with german words (1908814 entries), can't tell for sure if not sorted by frequency, but probably it ain't.

I use my emacs config (mainly corfu + cape) on both a well equipped laptop (no issues) and a less so phone.

cape-dict-grep I set to nil as otherwise the umlauts get garbled somehow in the completion popups.

On the phone I can as usual start typing words i. e. aalä of german word aalähnlich and when hitting TAB get the completion all fine.

Same goes on the phone with beso of german word besoffen.

But then problems start to arise, no completions for words buried deeper in the wordlist on the phone.

Resorting to find-file wordlist.txt in another buffer with cape-dabbrev did load completions up to words starting with letter v of the alphabet but far too many (70k in one case) thus killing emacs.

My question would be is there any fix possible for using cape-dict on devices more on the low end or do I misconceive something already possible in cape otherwise ?

;;.emacs
;; @out@
;; @scowl@/share/dict/words.txt
;; @hunspellDicts_de_DE@/share/hunspell/de_DE.aff
(message "https://www.gnu.org/software/emacs/manual/html_node/efaq/Learning-how-to-do-something.html")
(message "configuration is %S" "templated from home/misc/emacs.el: @out@ see C-x b *Messages* for the real path of emacs.el")
(message "works")


(custom-set-variables
 '(ispell-alternate-dictionary "/sdcard/wordlist-german.txt")
 )

;; A simple way to manage personal keybindings.
;; needed by use-package
;; M-x describe-personal-keybindings
 (use-package bind-key
   :demand t)

(use-package gcmh
  :ensure t
  :diminish
  :init (setq gc-cons-threshold most-positive-fixnum)
  :hook (emacs-startup . gcmh-mode)
  :custom
  (gcmh-idle-delay 'auto)
  (gcmh-auto-idle-delay-factor 10)
  (gcmh-high-cons-threshold (* 16 1024 1024)))

(which-key-mode)

(use-package corfu
  ;; Optional customizations
  :custom
  (corfu-auto t)                    ;; Enable auto completion

  :init
  (global-corfu-mode)
)

;; A few more useful configurations...
(use-package emacs
  :custom
  ;; Enable indentation+completion using the TAB key.
  ;; `completion-at-point' is often bound to M-TAB.
  (tab-always-indent 'complete)

  ;; Emacs 30 and newer: Disable Ispell completion function. As an alternative,
  ;; try `cape-dict'.
  (text-mode-ispell-word-completion nil)

  ;; Hide commands in M-x which do not apply to the current mode.  Corfu
  ;; commands are hidden, since they are not used via M-x. This setting is
  ;; useful beyond Corfu.
  (read-extended-command-predicate #'command-completion-default-include-p))

(use-package cape
  ;; Press C-c p ? to for help.
  :bind ("C-c p" . cape-prefix-map) ;; Alternative keys: M-p, M-+, ...
  :init
  ;; Add to the global default value of `completion-at-point-functions' which is
  ;; used by `completion-at-point'.  The order of the functions matters, the
  ;; first function returning a result wins.  Note that the list of buffer-local
  ;; completion functions takes precedence over the global list.
  (add-hook 'completion-at-point-functions #'cape-dabbrev)
  (add-hook 'completion-at-point-functions #'cape-file)
  (add-hook 'completion-at-point-functions #'cape-elisp-block)
  (add-hook 'completion-at-point-functions #'cape-dict)

  :config ;; start emacs ; C-x b *scratch* ; start typing ; C-c p w should suggest from dictionary now
  (setq cape-dict-file "/sdcard/wordlist-german.txt")
  (setq cape-dict-grep nil)
  (setq cape-dict-limit 10)
  ;; https://github.com/minad/cape/blob/ae98ec2/README.org#capf-transformers
(defun cape-dabbrev-dict-keyword ()
  (cape-wrap-super #'cape-dabbrev #'cape-dict #'cape-keyword))
  (setq-local completion-at-point-functions (list #'cape-dabbrev-dict-keyword))
  )

;; https://emacs.stackexchange.com/questions/73878/how-to-start-scratch-buffer-with-olivetti-org-mode-and-exotica-theme-altogether?rq=1
(defun my/initial-layout ()
  "Create my initial screen layout."
  (interactive)
  ;;(find-file-literally "/sdcard/wordlist-german.txt")
  ;; 2. having org-mode launch in scratch buffer from the beginning, and
  (switch-to-buffer "*scratch*")
  (org-mode)
  ;; (org-indent-mode)
  ;; 3. to have olivetti mode enabled too.
  (olivetti-mode)
  (delete-other-windows)
  )

(my/initial-layout)

[minad]

Hmm, I think adding cape-dict-grep was a mistake. I removed it again c0ffca8.

[minad]

As an alternative one could consider a version which works differently, loads the entire word list into a buffer and then dynamically searches through this buffer. This should be more efficient and less costly than creating hundreds of thousands of small strings, but the implementation would be quite different from cape-dict in its current form.