The Image Moderation Model is popular with many types of business that work with User Generated Content (UGC) such as social media and eCommerce sites. The Moderation Model can help ensure that you are providing a safe resource for your end users and that you are protecting your business from potential repetitional damage.
For example, the Moderation Model might return the following information for the image above:
Concept | Prediction |
suggestive | 0.76 |
explicit |
0.24 |
safe | 0.01 |
drug | 0.00 |
gore | 0.00 |
Getting Started
First things first. You will need to set up a Clarifai account and create an application. This how-to article shows you how to moderate images with the Clarifai API and through Portal. If you would like to moderated images via API, you will also need to generate an API key.
Moderate images in Portal
You can do almost anything that Clarifai can do with Clarifai Portal, and we work hard to make Portal the world's easiest interface for using AI. Moderating images with Portal is as simple as uploading your data, and choosing the right base workflow.
Create your application and choose "Moderation" as your base workflow
Simply log in to Clarifai Portal and create a new application. To use the wedding model, select "Moderation" as your base workflow.
View your image in Explorer view
Upload an image to your application and view predictions in the righthand sidebar under the tab that says "App Workflow".
Moderate images hosted on a local drive
Use the following Python snippet as an example of how to run a prediction on an image hosted on your local computer. For more details and information on working with predictions in our other client languages, please refer to our API documentation.
from clarifai_grpc.grpc.api import service_pb2, resources_pb2 from clarifai_grpc.grpc.api.status import status_code_pb2 # This is how you authenticate. metadata = (('authorization', 'Key {{YOUR_CLARIFAI_API_KEY}}'),) with open("{YOUR_IMAGE_FILE_LOCATION}", "rb") as f: file_bytes = f.read() request = service_pb2.PostModelOutputsRequest( model_id='d16f0bd0e7154d478c7ae150069bd2c6', inputs=[ resources_pb2.Input( data=resources_pb2.Data( image=resources_pb2.Image( base64=file_bytes ) ) ) ]) response = stub.PostModelOutputs(request, metadata=metadata) if response.status.code != status_code_pb2.SUCCESS: raise Exception("Request failed, status code: " + str(response.status.code)) for concept in response.outputs[0].data.concepts: print('%12s: %.2f' % (concept.name, concept.value))
Moderate images hosted on the web
Here is an example of how to run a prediction on an image that is hosted on a URL. This snippet is in Python, but we offer support for many other client languages. Please refer to our API documentation for additional information.
from clarifai_grpc.grpc.api import service_pb2, resources_pb2 from clarifai_grpc.grpc.api.status import status_code_pb2 # This is how you authenticate. metadata = (('authorization', 'Key {{YOUR_CLARIFAI_API_KEY}}'),) request = service_pb2.PostModelOutputsRequest( model_id='d16f0bd0e7154d478c7ae150069bd2c6', inputs=[ resources_pb2.Input(data=resources_pb2.Data(image=resources_pb2.Image(url='{{YOUR_IMAGE_URL}}'))) ]) response = stub.PostModelOutputs(request, metadata=metadata) if response.status.code != status_code_pb2.SUCCESS: raise Exception("Request failed, status code: " + str(response.status.code)) for concept in response.outputs[0].data.concepts: print('%12s: %.2f' % (concept.name, concept.value))