Kohaku-Blueleaf
c4afdb7895
For no constraint
2024-02-22 00:43:32 +08:00
Kohaku-Blueleaf
64179c3221
Update network_oft.py
2024-02-21 22:50:43 +08:00
Kohaku-Blueleaf
591470d86d
linting
2024-02-20 17:21:34 +08:00
Kohaku-Blueleaf
a5436a3ac0
Update network_oft.py
2024-02-20 17:20:14 +08:00
AUTOMATIC1111
6e4fc5e1a8
Merge pull request #14871 from v0xie/boft
...
Support inference with LyCORIS BOFT networks
2024-02-19 10:05:30 +03:00
Kohaku-Blueleaf
4eb949625c
prevent undefined variable
2024-02-19 14:43:07 +08:00
Kohaku-Blueleaf
5a8dd0c549
Fix rescale
2024-02-18 14:58:41 +08:00
catboxanon
06ab10a1be
Normalize cmd arg paths
...
In particular, this fixes an issue on Windows where some functions
will misbehave if forward slashes are provided rather than
double backslashes.
2024-02-15 14:22:13 -05:00
Kohaku-Blueleaf
90441294db
Add rescale mechanism
...
LyCORIS will support save oft_blocks instead of oft_diag in the near future (for both OFT and BOFT)
But this means we need to store the rescale if user enable it.
2024-02-12 14:25:09 +08:00
v0xie
eb6f2df826
Revert "fix: add butterfly_factor fn"
...
This reverts commit 81c16c965e
.
2024-02-08 22:00:15 -08:00
v0xie
613b0d9548
doc: add boft comment
2024-02-08 21:58:59 -08:00
v0xie
325eaeb584
fix: get boft params from weight shape
2024-02-08 11:55:05 -08:00
v0xie
2f1073dc6e
style: fix lint
2024-02-07 04:55:11 -08:00
v0xie
81c16c965e
fix: add butterfly_factor fn
2024-02-07 04:54:14 -08:00
v0xie
a4668a16b6
fix: calculate butterfly factor
2024-02-07 04:51:22 -08:00
v0xie
9588721197
feat: support LyCORIS BOFT
2024-02-07 04:49:17 -08:00
AUTOMATIC1111
358e9e2847
Merge pull request #14726 from v0xie/fix-oft-device
...
Fix kohya-ss OFT network wrong device for eye and constraint
2024-01-23 22:34:24 +03:00
AUTOMATIC1111
569dc1919c
Merge pull request #14588 from Sj-Si/feature/extra-networks-tree-view
...
Feature: Extra Networks Tree View
2024-01-22 22:24:06 +03:00
v0xie
fd383140cf
fix: wrong devices for eye and constraint
2024-01-22 02:52:34 -08:00
chi2nagisa
e280eb4055
fix using wrong model caused by alias
2024-01-16 03:45:19 +08:00
Sj-Si
036500223d
Merge changes from dev
2024-01-11 16:37:35 -05:00
Sj-Si
0726a6e12e
Finish base layout. Fix bugs. Need to test for stability and clean up.
2024-01-11 15:06:57 -05:00
AUTOMATIC1111
8b6848c6db
Merge pull request #14546 from AUTOMATIC1111/fix-oft-dtype
...
Fix dtype casting in OFT module
2024-01-06 10:50:38 +03:00
Kohaku-Blueleaf
44744d6005
linting
2024-01-05 16:38:05 +08:00
Kohaku-Blueleaf
18ca987c92
Add general forward method for all modules.
2024-01-05 16:32:19 +08:00
Kohaku-Blueleaf
f8f38c7c28
Fix dtype casting for OFT module
2024-01-05 16:31:48 +08:00
Learwin
d4945f4422
Removed weight slider for negative prompts
2023-12-31 13:22:30 +01:00
Learwin
a2f23f9d22
Code Style fixes
2023-12-30 22:16:51 +01:00
Learwin
bc5ae74c7d
Added negative prompts to extra networks lora
2023-12-30 21:52:27 +01:00
w-e-w
59d060fd5e
More lora not found warning
2023-12-30 17:11:03 +09:00
Kohaku-Blueleaf
0fb34b57b8
Merge branch 'dev' into test-fp8
2023-12-14 16:54:45 +08:00
AUTOMATIC1111
2be85f8fe0
Merge pull request #14237 from ReneKroon/dev
...
#13354 : solve lora loading issue
2023-12-14 10:15:36 +03:00
AUTOMATIC1111
6ef0ff39f2
Merge pull request #14300 from AUTOMATIC1111/oft_fixes
...
Fix wrong implementation in network_oft
2023-12-14 10:14:19 +03:00
AUTOMATIC1111
778a30a95e
Merge pull request #14237 from ReneKroon/dev
...
#13354 : solve lora loading issue
2023-12-14 10:08:03 +03:00
Kohaku-Blueleaf
3772a82a70
better naming and correct order for device.
2023-12-14 01:47:13 +08:00
Kohaku-Blueleaf
8fc67f3851
remove debug print
2023-12-14 01:44:49 +08:00
Kohaku-Blueleaf
265bc26c21
Use self.scale instead of custom finalize
2023-12-14 01:43:24 +08:00
Kohaku-Blueleaf
735c9e8059
Fix network_oft
2023-12-14 01:38:32 +08:00
Rene Kroon
16bdcce92d
#13354 : solve lora loading issue
2023-12-08 21:20:55 +01:00
Kohaku-Blueleaf
370a77f8e7
Option for using fp16 weight when apply lora
2023-11-21 19:59:34 +08:00
Kohaku-Blueleaf
b60e1088db
Merge branch 'dev' into test-fp8
2023-11-19 15:24:57 +08:00
AUTOMATIC1111
337bc4a2fb
Merge pull request #13014 from AUTOMATIC1111/thread-safe-extranetworks-list_items
...
thread safe extra network list_items
2023-11-19 09:09:21 +03:00
v0xie
eb667e715a
feat: LyCORIS/kohya OFT network support
2023-11-15 18:28:48 -08:00
v0xie
d6d0b22e66
fix: ignore calc_scale() for COFT which has very small alpha
2023-11-15 03:08:50 -08:00
v0xie
bbf00a96af
refactor: remove unused function
2023-11-04 14:56:47 -07:00
v0xie
329c8bacce
refactor: use same updown for both kohya OFT and LyCORIS diag-oft
2023-11-04 14:54:36 -07:00
v0xie
f6c8201e56
refactor: move factorization to lyco_helpers, separate calc_updown for kohya and kb
2023-11-03 19:35:15 -07:00
v0xie
fe1967a4c4
skip multihead attn for now
2023-11-03 17:52:55 -07:00
v0xie
d727ddfccd
no idea what i'm doing, trying to support both type of OFT, kblueleaf diag_oft has MultiheadAttn which kohya's doesn't?, attempt create new module based off network_lora.py, errors about tensor dim mismatch
2023-11-02 00:13:11 -07:00
v0xie
65ccd6305f
detect diag_oft type
2023-11-02 00:11:32 -07:00