Overview
Comment: | [core] gc engine: new char to merge tokens |
---|---|
Downloads: | Tarball | ZIP archive | SQL archive |
Timelines: | family | ancestors | descendants | both | core | rg |
Files: | files | file ages | folders |
SHA3-256: |
4e6d5990624ea2d29c70312b081edfd4 |
User & Date: | olr on 2018-06-26 12:34:05 |
Other Links: | branch diff | manifest | tags |
Context
2018-06-26
| ||
12:34 | [fr] conversion: regex rules -> graph rules check-in: 483fd2c907 user: olr tags: fr, rg | |
12:34 | [core] gc engine: new char to merge tokens check-in: 4e6d599062 user: olr tags: core, rg | |
09:58 | [core] token neutralization check-in: b5ff33ce96 user: olr tags: core, rg | |
Changes
Modified gc_core/py/lang_core/gc_engine.py from [f034e8dbe9] to [f2e9903477].
︙ | ︙ | |||
899 900 901 902 903 904 905 | if sWhat == "*": # purge text if nTokenRewriteEnd - nTokenRewriteStart == 0: self.lToken[nTokenRewriteStart]["bToRemove"] = True else: for i in range(nTokenRewriteStart, nTokenRewriteEnd+1): self.lToken[i]["bToRemove"] = True | | | 899 900 901 902 903 904 905 906 907 908 909 910 911 912 913 | if sWhat == "*": # purge text if nTokenRewriteEnd - nTokenRewriteStart == 0: self.lToken[nTokenRewriteStart]["bToRemove"] = True else: for i in range(nTokenRewriteStart, nTokenRewriteEnd+1): self.lToken[i]["bToRemove"] = True elif sWhat == "␣": # merge tokens self.lToken[nTokenRewriteStart]["nMergeUntil"] = nTokenRewriteEnd elif sWhat == "!": # immunity if nTokenRewriteEnd - nTokenRewriteStart == 0: self.lToken[nTokenRewriteStart]["bImmune"] = True else: |
︙ | ︙ |