[ComfyUI]Flux：完美平衡！更适合F1反推模型！30秒速率1G低显存CLIP和T5双通道提示反推和标注皆可用

大家好我是安琪！！！

在数字艺术领域，AI绘画技术已经逐渐成为艺术创作的新趋势。现在，ComfyUI的Flux功能结合F1反推模型，为用户提供了完美的平衡，让你在创作中更加得心应手。

在这里插入图片描述

Florence2PromptGen简介

在之前文章已经过一些LLM智能反推的ComfyUI插件，在AI迅猛发展的当下，技术日新月异层出不穷。今天文章主题将介绍一款更适合于Flux模型的提示词反推大模型：Florence2PromptGen。当前版本为Florence-2-large-PromptGen v1.5，这是专门为ComfyUI的MiaoshouAI Tagger训练的模型。是基于Microsoft Florence-2模型的精心微调版本。

• 保持了与Joy模型相近的优秀详细的反推提示词能力（实测接近joy性能，但略逊色一筹）。基于精选的 Civitai 图像和清洗标签数据集进行微调，生成高度精确和上下文相关的标签。
• 仅需最小1G显存可运行（注：JOY需要7G显存运行）
• 同时还保持了Microsoft Florence-2模型的快速高效性能（本地测试仅需不到30秒反推时间）。
• 支持SD CLIP tag词组、T5自然语言多种反推提示语格式。还增加了CLIP和T5混合提示，能够完全的与Flux双通道相融合
• 提供了MiaoshouAI Tagger ComfyUI组件，能够实现自动化快速高级图像标注工具，也可用于Flux炼丹的自动化标注方案。利用 ComfyUI 的节点系统的强大功能，将标注节点连接起来，结合描述性打标和关键词标注以获得最佳效果。

官方演示

Florence2PromptGen ComfyUI体验

官方团队通过精心训练了Florence-2-large-PromptGen v1.5模型，同时还提供了ComfyUI-Miaoshouai-Tagger ComfyUI插件。在插件中集成了一系列COmfyUI节点，特别对Flux定制化MiaoshouAI Flux CLIP Text Encode界面实现提示词双通道介入。无需下载任何模型，首次运行时会自动下载。其中模型包含Base和 Large 两个版本，推荐使用 Large 版本。

• ComfyUI-Miaoshouai-Tagger插件地址 （需要相关模型的同学可自行扫描获取）

在这里插入图片描述

Flux 文生图工作流

Florence2PromptGen工作流

插件新增反推节点如下。这里可以选择多种模型，SD模型使用tag词组方式：SD3类T5自然语言模型使用details方式；Flux更建议选择mixed混合T5和CLIP双通道模式。使用模型建议直接large模型，整体并不耗显存和性能，直接默写large更大精调版本。

01. 出水芙蓉

T5自然语言提示：

a digital illustration in a realistic, hyper-realistic style, depicting a young woman with a serene, ethereal appearance, she has fair skin, large, expressive blue eyes, and long, dark brown hair styled in a loose, elegant updo, her facial features are delicate, with a slight blush on her cheeks and a soft, inviting smile, she wears a white, long-sleeved blouse with a high collar and intricate lace trim, which adds a touch of elegance and softness to her appearance, the blouse is slightly transparent, allowing the viewer to see the delicate petals and the softness of her skin, she is seated in a shallow pool of water, surrounded by white flowers with delicate, white petals, which are partially submerged in the water, creating a tranquil, serene atmosphere, the background is a gradient of soft, pastel green hues, enhancing the ethereal quality of the scene, the overall composition is balanced and harmonious, with the woman’s serene expression and the delicate beauty of the flowers in the background, the illustration is highly detailed, with smooth textures and subtle shading that enhances the realism and depth of the subject’s features, making it appear almost three-dimensional, the image exudes a sense of tranquility and serenity, blending elements of natural beauty and tranquility in a harmonious blend of realism and fantasy (realism)

CLIP词组提示：

korean, 1girl, solo, long hair, looking at viewer, smile, black hair, shirt, long sleeves, jewelry, sitting, closed mouth, white shirt, upper body, flower, earrings, outdoors, water, white flower, lips, fingernails, parted lips, white pants, lily pad

02. 樱花盛开

T5自然语言提示：

a digital illustration in a realistic, semi-realistic style, depicting a young woman with a delicate, ethereal appearance, she has fair skin, large, expressive blue eyes, and long, straight black hair that cascades over her shoulders, her facial features are delicate, with a slight blush on her cheeks and a soft, inviting smile, she is dressed in a traditional white ao dai, a traditional Vietnamese dress with a high collar and long sleeves, adorned with intricate lace and floral patterns, the dress is flowing gracefully, adding a sense of movement and elegance, she holds a large, white parasol with a wooden handle, which is adorned with delicate pink cherry blossom petals, the background features a serene, pastel-colored landscape with a hint of green foliage, suggesting a tranquil, possibly a park or garden setting, the overall color palette is soft and muted, with soft pastel hues that enhance the ethereal quality of the scene, the illustration is highly detailed, with smooth textures and subtle shading, giving it a lifelike quality, the artist’s signature is visible in the bottom right corner, indicating the work’s creator

CLIP词组提示：

1girl, solo, long hair, looking at viewer, blush, black hair, dress, holding, jewelry, closed mouth, standing, flower, earrings, outdoors, sky, day, cloud, white dress, tree, lips, umbrella, white umbrella, cherry blossoms, holding umbrella

03. 金钱袋

T5自然语言提示：

a high-resolution photograph featuring a golden, intricately embroidered pouch with a double happiness symbol in the center, surrounded by floral motifs in pastel colors, the pouch is intricately designed with a smooth, satin-like texture, and it is tied with a thin, golden ribbon at the top, in front of the pouch, a red beaded necklace with white pearls strung around it is placed on a dark surface, possibly a table, the background is a solid black, which contrasts sharply with the golden pouch and beads, creating a striking visual effect, the beads are round and smooth, with a glossy finish, and the pouch itself is adorned with intricate floral patterns in shades of pink, purple, and yellow, adding a touch of elegance to the overall composition, the overall mood is festive and celebratory, likely celebrating the chinese new year, as indicated by the golden coins scattered around the pouch and the vibrant red beads, the texture of the beads and pouch is smooth and polished, enhancing the luxurious and festive feel of the scene

CLIP词组提示：

1girl, solo, closed mouth, flower, blurry, no humans, blurry background, beads, coin, drawstring bag, pearl, red beads

04. 顽强的活下去

T5自然语言提示：

a photograph captures a solitary ant carrying a piece of driftwood during sunset, the ant is positioned on a rocky surface, with its body facing towards the left side of the frame, the background is a gradient of warm, golden hues, transitioning from a deep orange at the top to a bright yellow at the bottom, with the sun partially visible behind it, creating a dramatic, almost ethereal effect, the driftwood is held in place by thin, wooden sticks that are attached to the ant’s legs, forming a bridge-like structure that extends from its head to its antennae, the texture of the wood appears rough and slightly weathered, with visible cracks and crevices, adding to the ruggedness of the surface beneath the ant, the overall mood of the photograph is serene and contemplative, emphasizing the contrast between the natural beauty of the sunset and the stark contrast of the ant and its surroundings, the image exudes a sense of solitude and introspection, as if the ant carries the piece of wood as a symbol of resilience and strength in the face of adversity, the photograph captures the essence of a moment of isolation and resilience in the midst of a natural, untamed landscape during sunset

CLIP词组提示：