Memetica

Online trolls recently began adopting a new text-to-image model, FLUX.1 from Black Forest Labs. Since it was released, more than 150 discussion threads have been devoted to FLUX.1 on 4chan. The conversations feature a wide range of prompt architecture tutorials for images that include racism, misogyny, and nonconsensual intimate images (#NCII) of women. After Microsoft and OpenAI cracked down on platform abuse following the Taylor Swift synthetic image incident earlier this year, fringe troll communities have increasingly adopted less moderated and oftentimes open-source models to produce similarly problematic content. Their ongoing ability to produce these images at scale has continued to drive the flood of synthetic NCII images and other more benign forms of AI slop on social media over the past year. If FLUX.1 is increasingly adopted by fringe platform communities and, in turn, politically motivated trolls, the platform may be used to create election-specific disinformation content in the months leading up to the 2024 election. #GenAI #trustandsafety #onlineharm #misinformation

Far-right riots in the UK brought renewed attention to the nexus between online hate speech and real-world violence. Many far-right groups leveraged Telegram to rapidly spread xenophobic conspiracies in the hopes of inciting further violence offline. Over the past week networks of far-right Telegram channels began distributing messages from an anonymous origin containing a list of more than 35 locations of immigration groups offices and asylum communities across the UK, alongside a call for nationwide protests on August 7. The message emerged first in small far-right communities on Telegram and reached within hours to wider audiences, on multiple platforms. While the August 7 protests did not lead to mass violence, the mass mobilization did trigger widespread disruptions across the country, underscoring the constant need to monitor fringe platforms like Telegram. #misinformation #CVE  

Our CEO Benjamin T Decker will be at #Trustcon next week. Get in touch to learn more about Memetica's service offerings!

When you help put a stop to counterfeiting and other fraud online, you can take a bite out of much more serious crimes like terrorism. Find out how! Join EverC strategist Maya S. and Benjamin T Decker of Memetica for a webinar sponsored by the Association of Payment Professionals tomorrow. Register here: https://lnkd.in/e5Np8tnJ #saferecommerce

Our team identified a number of uncensored copies of Microsoft's WizardLM-2 circulating on social media in the days after it was taken offline. Read more about it in the latest from 404 Media https://lnkd.in/eKua2SNg