Library 1.6.2

What's Changed

• Properly preserve specified markers (matching fix in machine) by @Enkidu93 in #167

Full Changelog: v1.6.1...v1.6.2

Library 1.6.1

What's Changed

• Fix colon index check by @isaac091 in #164

Full Changelog: v1.6.0...v1.6.1

Library 1.6.0

What's Changed

• Add confidences to word pair representation by @Enkidu93 in #156
• Small fixes for WA by @Enkidu93 in #158
• Remove 'tm' intermediate directory by @Enkidu93 in #160
• Updates to USFM updater by @johnml1135 in #161
• change to SDPA by @johnml1135 in #162

Full Changelog: v1.5.0...v1.6.0

docker_1.9.4

What's Changed

• Add confidences to word pair representation by @Enkidu93 in #156
• Small fixes for WA by @Enkidu93 in #158
• Remove 'tm' intermediate directory by @Enkidu93 in #160
• Updates to USFM updater by @johnml1135 in #161
• change to SDPA by @johnml1135 in #162

Full Changelog: v1.5.0...docker_1.9.4

Library 1.5.0

What's Changed

• Make attn_implementation configurable for huggingface models by @isaac091 in #146
• Word alignment Refinement by @Enkidu93 in #151
• Use S3 path type by @johnml1135 in #152
• Hotfix: remove attention implementation by @johnml1135 in #154
• Do not translate markers by @johnml1135 in #153

Full Changelog: v1.4.1...v1.5.0

Library 1.4.1

What's Changed

• Fix source tokens for HF fast tokenizers by @ddaspit in #133
• Add environment variable to dockerfiles to skip pip install by @mshannon-sil in #134
• Update to support Python 3.9-3.12 by @TaperChipmunk32 in #131
• fix docker build by @johnml1135 in #136
• Fix USX corpus issues by @ddaspit in #138
• fix deprecated tokenizer methods, add test cases by @mshannon-sil in #139
• Fix moses punct by @johnml1135 in #140
• Automatically run poetry install and set default python on devcontainer startup by @mshannon-sil in #143
• Raise error when id tag doesn't match filename book id by @mshannon-sil in #141
• Update learning rate for #116 and other small error by @johnml1135 in #117
• Update to macOS-13 by @johnml1135 in #147

Full Changelog: v1.2.0...v1.4.1

Library 1.2.0

What's Changed

• Updated get_books by @TaperChipmunk32 in #122
• fix default for BiblicalTermsListSetting by @mshannon-sil in #125
• Fix Jupyter notebooks by @ddaspit in #127
• Add Paratext/USFM processing tutorial by @ddaspit in #130
• Add MT tutorial by @ddaspit in #129

New Contributors

• @TaperChipmunk32 made their first contribution in #122

Full Changelog: v1.1.0...v1.2.0

Library 1.1.0

What's Changed

• Upgrade machine.py production docker container to python 3.11 by @mshannon-sil in #82
• Create more robust check for old vs new book selection syntax by @isaac091 in #87
• Restrict build options to only update model hyperparameters by @ddaspit in #88
• Update error message to include filename by @isaac091 in #90
• swap out 600M param model for tiny for faster startup by @johnml1135 in #92
• Add test for default attributes in USFM by @ddaspit in #93
• use sacremoses normalizer, ensure pretranslate.src.json and pretranslate.trg.json use same directory by @mshannon-sil in #96
• Clean up get_chapters code and expand tests by @isaac091 in #97
• Refactor get_chapters to not reuse code and add additional tests by @isaac091 in #98
• And upgrade torch, numpy, pandas and accelerate as well as black, pyr… by @johnml1135 in #100
• Add option to save the model during build job by @ddaspit in #99
• Update machine.py to reflect usfm changes in machine by @mshannon-sil in #103
• fix normalization order in find_missing_characters() by @mshannon-sil in #105
• Parallel to sillsdev/machine#187 by @Enkidu93 in #106
• Use macos-12 GHA runner by @ddaspit in #109
• Smt build job by @johnml1135 in #107
• Scripture range parser no error on empty string by @Enkidu93 in #110
• update shared_file_uri by @mshannon-sil in #113
• Port USFM code from Machine up to commit a9058ce by @mshannon-sil in #111
• Port USFM code from Machine up to commit bf2b46d by @mshannon-sil in #115
• Alignment Job by @johnml1135 in #114
• Port USFM code from Machine up to commit c93f8dc by @mshannon-sil in #118
• small fix for NMT build job by @johnml1135 in #119
• small fixes by @johnml1135 in #120

New Contributors

• @Enkidu93 made their first contribution in #106

Full Changelog: v1.0.2...v1.1.0

docker_1.6.3

What's Changed

• New feature: Word alignment Job by @johnml1135 in #114
• Port USFM code from Machine up to commit a9058ce by @mshannon-sil in #111
• Port USFM code from Machine up to commit bf2b46d by @mshannon-sil in #115
• Port USFM code from Machine up to commit c93f8dc by @mshannon-sil in #118
• Scripture range parser no error on empty string by @Enkidu93 in #110
• update shared_file_uri by @mshannon-sil in #113
• small fix for NMT build job by @johnml1135 in #119
• small fixes by @johnml1135 in #120

Full Changelog: docker_1.5.4...docker_1.6.3

Docker 1.5.4

What's Changed

• Use macos-12 GHA runner by @ddaspit in #109
• Smt build job by @johnml1135 in #107
• CPU only docker image

Full Changelog: docker_1.4.0...docker_1.5.4