Topic: More whitelist imports and scraping

Posted under Site Bug Reports & Feature Requests

Enkin

Member

There is a lot of ai content on Tantabus.ai which is the pony centric booru for ai generators. Since this e6ai already had pony directors there's no real reason that this shouldn't be included in the list for easy importing.

Autoimports provided it has enough tags are also very beneficial to keeping the content flowing, some boorus have a timer before scraping so it has more tags than on first upload. Yerf autoimports everything from everywhere, and there are other boorus that autoimport from other sources like Ponybooru/Twibooru/Derpibooru/

There is a very big amount of furry on pixai, which I prefer over civitai. pixai has it's own generator for furry with their own models and whitelisting that site would make imports much easier. They have a content filter where you can generate nsfw but it's only supposed to show on your side, not to the public. So Blep whitelisting the site can be a way to share all sorts of genai furry

I'm all for hosting more art, but this sounds like it could cause problems with duplication, flooding the search results with "older" art, not to mention that Blep submissions needs to be reviewed for quality by fleshy humans.

On that last point, Derpibooru has limited allowance for AI art with very strict quality requirements, so pulling art from there without review might be possible. Plus there's not a whole lot of it.

Enkin

Member

artificialdragon said:
I'm all for hosting more art, but this sounds like it could cause problems with duplication, flooding the search results with "older" art, not to mention that Blep submissions needs to be reviewed for quality by fleshy humans.

On that last point, Derpibooru has limited allowance for AI art with very strict quality requirements, so pulling art from there without review might be possible. Plus there's not a whole lot of it.

You're right dups can be a problem. In sites that host multi imports on boorus they have tools to manually review or deny. Since Blep image matching on upload, I would think it can do image-matching to deny or reduce dups as well.

Enkin

Member

Please add https://beastforge.org/ to the whitelist, with the scraping tyto set up it would make imports from there to here much easier to catch what gets missed from people not on DNP

scout

Janitor

enkin said:
Please add https://beastforge.org/ to the whitelist, with the scraping tyto set up it would make imports from there to here much easier to catch what gets missed from people not on DNP

All 3 major AI furry-only boorus have now been added to the whitelist to allow a direct url link in the upload field, as long as the URL pattern matches the best quality version of the file and not a sample image that has been downsized and compressed to lower quality or another file type.

URL Patterns

Pawbooru

Accepted
Rejected

BeastForge

Accepted
Rejected

Floofgens

Accepted
Rejected

enkin said:
There is a very big amount of furry on pixai

I haven't yet checked how PixAI handles direct URL links yet, because it requires you to log in to see non-vanilla content, so if the grabber can't access some of the images on that site, we can't whitelist the entire domain. If you can confirm with examples that direct links will function regardless of its nsfw filter, we'll be able to add it to the list as well.