https://zhuanlan.zhihu.com/p/720780466
Flux的全量大模型要22G,量化版的也要16G以上才能跑的很好,像我12G显存只能勉强跑,效率非常低。
好像是是,很多创作者通过各种优化精简了Flux模型,基本实现了小显存可以跑起来,甚至可以跑得很快。
今天推荐一个6步就可以出图的Flux模型,同时支持涩涩(官方大模型无法涩涩):Flux1 - Dev NF4 6 steps NSFW & Hybrid FP8 4 steps NSFW。
作者在C站称:
Flux1-Hybrid:结合Dev的真实感、Schnell的速度和改进的提示遵循性
引言:
介绍您的新型扩散模型,突出其独特的真实感、速度和提示遵循性的结合。强调与Dev和Schnell等其他流行选项相比,使用此模型的好处。它非常适合计算资源有限但想要快速生成高质量图像的用户。
主要特点:
4步生成:与许多其他模型相比,以一小部分时间生产高质量图像。
增强的提示遵循性:准确捕捉提示的细微差别,从而产生更相关和创造性的输出。
照片级质量:实现与Dev相媲美的真实感,同时保持Schnell的多功能性。
CFG灵敏度:通过CFG尺度提供对图像生成的细粒度控制。
与其他模型的比较:
创建一个详细的比较表:
特性 | Flux1-Hybrid | Dev | Schnell |
---|---|---|---|
提示遵循性 | 优秀 | 非常好 | 好 |
真实感 | 高 | 非常高 | 中等 |
多功能性 | 高 | 高 | 高 |
效率 | 高(4步) | 低 | 中等 |
光照质量 | 非常好 | 优秀 | 好 |
细节 | 高 | 非常高 | 中等 |
艺术风格 | 多样 | 真实感 | 艺术感 |
分析:
提示遵循性:我们的混合模型始终生成与提供的提示紧密对齐的图像,在这一点上超越了Dev。
真实感:虽然Dev在照片级真实感方面表现出色,我们的模型提供了一种更平衡的方法,结合了真实元素和艺术风格。
效率:4步生成过程使我们的模型比Dev快得多,而不会牺牲质量。
多功能性:我们的混合模型能够产生从照片级肖像到抽象艺术的广泛风格。
推理时间:Intel I5,32 RAM,Nvidia 3060 12Gb,45秒(相同设置,Dev,2分42秒)。在ComfyUI上使用SwarmUI进行测试。
注意事项:图像生成时间是在模型预加载的情况下测量的。从点击生成按钮到图像结束。模型首先制作一个初始图像,然后通过4步进行细化,这4步的时间远少于初始图像的生成时间。
如何使用:
推荐设置:随机种子,CFG=1(0.8-1.2)范围,采样器:欧拉,调度器:正常/简单,在示例中分辨率:5:8(768x1216)。
Clip、T5编码器和vae与Kijai Flux1-FP8结合使用。建议使用--lowvram界面标志将编码器的句柄传递给CPU。
限制:非扭曲图像的CFG范围较窄。真实图像受CFG影响,抽象和风景则不是,因此对于没有人物的图像,在暗图像中您可以提高CFG,在亮图像中您可以稍微降低CFG(0.6-1.4)。没有像Dev模型中的FluxGuidance。文本是一个需要解决的问题。
该模型默认欧美风格,为了更符合中国人的审美,以下示例我使用了墨幽的Lora,权重0.85,速度基本不受影响,3060 12G采用6步出图,极端情况下可以4步,几十秒即可,效率非常高。
1、黑夜给了我黑色的眼睛
提示词:
WALLPER,a medium-angle shot of an Asian woman with long black hair stands in front of a dark backdrop. She is dressed in a black strapless dress,adorned with a ruffled neckline. Her left arm is raised above her head,adding a touch of balance to the scene. The woman's face is angled towards the right,her lips are slightly parted,as if she's lips are pursed. Her eyes are closed,and her hair is cascading over her shoulders. The backdrop is a stark black,creating a stark contrast to the woman's outfit.,
2、你的眼眸,深邃的像银河
提示词:
WALLPERa close-up shot of a young Asian woman with longwavy black hair is adorned with gold hoop earrings. She is dressed in a white dress adorned with a floral pattern. The backdrop is blurredcreating a stark contrast to the woman's white dress. The sun is shining on the right side of the imageadding a touch of warmth to the scene.
3、闺房
提示词:
XS,masterpiece:1.2),best quality,high resolution,unity 8k wallpaper,(illustration:1),perfect lighting,extremely detailed CG,finely detail,extremely detailed,soft lighting and shadow,soft yet striking lighting,film grain:1.2,(skin pores:1.2),(detailed skin texture:1),((solo:1.5)),Detailed face,(see-through:1.1),misty,Low Key:1.1,depth of field,A young woman with dark hair and a floral top,sitting on what appears to be an armchair or sofa in her home.,
4、傍晚的街头
提示词:
GFSM,XS,masterpiece:1.2),best quality,high resolution,unity 8k wallpaper,(illustration:1),perfect lighting,extremely detailed CG,finely detail,extremely detailed,soft lighting and shadow,soft yet striking lighting,film grain:1.2,(skin pores:1.2),(detailed skin texture:1),((solo:1.5)),Detailed face,(see-through:1.1),misty,Low Key:1.1,depth of field,A woman in a black coat stands confidently amidst an urban backdrop,her gaze directed off to one side.,
5、浴缸
提示词:
XS,masterpiece:1.2),best quality,high resolution,unity 8k wallpaper,(illustration:1),perfect lighting,extremely detailed CG,finely detail,extremely detailed,soft lighting and shadow,soft yet striking lighting,film grain:1.2,(skin pores:1.2),(detailed skin texture:1),((solo:1.5)),Detailed face,(see-through:1.1),misty,Low Key:1.1,depth of field,A woman in a white dress lounging with her head on one hand and legs crossed,surrounded by rose petals inside an empty bathtub.,
6、仙气
提示词:
XSmasterpiece:1.2),best quality,high resolution,unity 8k wallpaper,(illustration:1),perfect lighting,extremely detailed CG,finely detail,extremely detailed,soft lighting and shadow,soft yet striking lighting,film grain:1.2,(skin pores:1.2),(detailed skin texture:1),((solo:1.5)),Detailed face,(see-through:1.1),misty,Low Key:1.1,depth of field,Elegance and Mystique: A Smoke Ring Emanates from a Woman's Mouth in an Artistic Portrait.
7、牛仔短裤
提示词:
XS,masterpiece:1.2),best quality,high resolution,unity 8k wallpaper,(illustration:1),perfect lighting,extremely detailed CG,finely detail,extremely detailed,soft lighting and shadow,soft yet striking lighting,film grain:1.2,(skin pores:1.2),(detailed skin texture:1),((solo:1.5)),Detailed face,(see-through:1.1),misty,Low Key:1.1,depth of field,A woman posing on a bed with her back to us,showcasing an off-the shoulder top and denim shorts.,
8、你蒙住了我的眼睛,说要给我幸福
提示词:
WALLPER,a medium-angle view of a woman's face,adorned with a white mask. The woman's head is encased in a veil,her hair cascades over her shoulders,adding a touch of beauty to the scene. Her eyes are closed,and her lips are painted a pinkish-pink shade. She is wearing a pair of gold earrings,and a black dress with a floral pattern on it. The backdrop is a soft,light blue,creating a stark contrast to the woman's white dress.,
9、你坐在月亮上,唱一首曾经的歌
提示词:
WALLPER,((best quality)), ((masterpiece)),A girl in Hanfu sitting on a crescent moon, wearing silk stockings and barefoot, surrounded by dreamy planets, viewed from the feet upwards, creating a mysterious and romantic atmosphere, high-quality image, high-resolution picture.
10、紫色长发
提示词:
WALLPER,a medium-angle shot of a young Asian girl with long vibrant purple hair stands in front of a light blue backdrop. Her eyes are a deep blue and her lips are a vibrant pink. Her hair is cascading down her right shoulder framing her face. She is wearing a light pink hoodie adorned with a silver chain around her neck adding a pop of color to her outfit. The backdrop is a stark light blue creating a stark contrast to the girl's purple hair.,
说明:这是6步快速模型,可以在8G甚至6G小显存上跑,追求速度的同时,必然会损失画质,只是在速度和画质之间,需要找一个平衡点。
我建议的玩法是先用该模型画出满意的作品,然后再用放大模型进行放大,从而实现细节的完美。
模型下载(含工作流):
https://pan.quark.cn/s/d2345727df75