{"id":236938,"date":"2025-02-28T13:30:04","date_gmt":"2025-02-28T05:30:04","guid":{"rendered":"https:\/\/www.grab.com\/sg\/?post_type=editorial&p=236938"},"modified":"2025-12-01T15:22:56","modified_gmt":"2025-12-01T07:22:56","slug":"how-large-language-models-help-us-make-more-precise-content-moderation-decisions","status":"publish","type":"editorial","link":"https:\/\/www.grab.com\/sg\/inside-grab\/stories\/how-large-language-models-help-us-make-more-precise-content-moderation-decisions\/","title":{"rendered":"How Large Language Models help us make more precise content moderation decisions"},"content":{"rendered":"\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t

At Grab, we want to provide a positive and safe experience for everyone using our app. Therefore, we need a solid content moderation system that helps us screen user-generated content\u2014such as merchant catalogues and user reviews\u2014to flag incidents of offensive language, inappropriate images, and so on.<\/p>

Thankfully, the vast majority of interactions and content uploaded to our platform is harmless. And with good content moderation, we can catch the bad apples early on.<\/p>

We\u2019ve always done this with a blend of AI-supported automated content filters and human moderators weighing in on the more complex decisions. More recently, however, the rise of Large Language Models (LLMs) made our automated systems more precise, which means we\u2019re getting more effective at quick, accurate content moderation at a mass-scale, while reducing the strain on our content moderation team. Here\u2019s how<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\"\"\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t
Content moderation is getting better thanks to LLMs<\/h5>

Grab\u2019s content moderation works in a two-tier system. In the first layer, we employ small, specialised AI models that can screen large amounts of content quickly and efficiently.<\/p>

An example of a Tier 1 model is keyword filtration. Based on a pre-defined list of problematic words, the system flags content that contains any of these words. Similarly, an AI model can screen images for potential violations after it has been pre-trained.<\/p>

Such task-specific AIs manage to \u201cpass\u201d or \u201cfail\u201d large amounts of data with high accuracy. Our Tier 1 models currently flag less than 5% of content as potential violations. These then get passed on to \u201clarge\u201d Tier 2 models for another assessment<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\"\"\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t
Context-aware decision-making with LLMs<\/h5>

In Tier 2, LLMs can make more complex, context-aware decisions. We can simply prompt the LLM with our violation policies on specific topics, let\u2019s say the sale of tobacco on Grab, or our sexual harassment policy. This applies even to complex scenarios, for example to differentiate traditional tobacco and e-cigarettes. The prompts for detecting all tobacco and the prompt for detecting e-cigarette are shown in the table below. This gives a high level of flexibility to handle complex scenarios defined in policies.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\"\"\t\t\t\t\t\t\t\t\t\t\t
Content moderation prompt examples<\/figcaption>\n\t\t\t\t\t\t\t\t\t\t<\/figure>\n\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t

The LLM can then assess how likely it is that a piece of content is in violation of one of our policies. A low score means the LLM is confident the content is safe. Meanwhile, a high score indicates the content should be filtered. A medium score means the LLM isn\u2019t quite sure\u2014it could go either way. That\u2019s where human moderators step in for the final say.<\/span><\/p>

This second layer of automated moderation is where we\u2019ve seen the most change. We started implementing LLMs in Tier 2 moderation in 2023 and are gradually expanding their use to additional cases through Q3 2024. Thus we are able to reduce 90% of human efforts in the moderation process and reduce SLA from days to minutes.<\/span><\/p>

Next steps: finetuning our models<\/h5>

We achieved great results leveraging LLMs, but we\u2019re still working on improvements, specifically in two areas:<\/span><\/p>

  • Latency: The LLM latency with image input is still quite high. We therefore need to improve latency to achieve use cases in which users get near-instant feedback about their uploaded content<\/span><\/li>
  • Accuracy: LLMs don\u2019t always have good knowledge on the topics we want to detect. Also, understanding local languages can be challenging. We therefore need to enhance the model\u2019s understanding of those areas<\/span><\/li><\/ul>

    Leveraging our in-house data, our team is constantly finetuning our content moderation LLMs to address the challenges above, with promising initial results.<\/span><\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t

    \n\t\t\t\t\t\t
    \n\t\t\t\t\t
    \n\t\t\t
    \n\t\t\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<\/div>\n\t\t","protected":false},"parent":180237,"menu_order":0,"template":"grab21-default","acf":[],"_links":{"self":[{"href":"https:\/\/www.grab.com\/sg\/wp-json\/wp\/v2\/editorial\/236938"}],"collection":[{"href":"https:\/\/www.grab.com\/sg\/wp-json\/wp\/v2\/editorial"}],"about":[{"href":"https:\/\/www.grab.com\/sg\/wp-json\/wp\/v2\/types\/editorial"}],"version-history":[{"count":32,"href":"https:\/\/www.grab.com\/sg\/wp-json\/wp\/v2\/editorial\/236938\/revisions"}],"predecessor-version":[{"id":254927,"href":"https:\/\/www.grab.com\/sg\/wp-json\/wp\/v2\/editorial\/236938\/revisions\/254927"}],"up":[{"embeddable":true,"href":"https:\/\/www.grab.com\/sg\/wp-json\/wp\/v2\/editorial\/180237"}],"wp:attachment":[{"href":"https:\/\/www.grab.com\/sg\/wp-json\/wp\/v2\/media?parent=236938"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}