Engagement Score

Measure how engaging LLM-generated marketing content is. Track reader interest and optimize copy impact.

Exclusive to enterprise customers. Contact us to activate this feature.

Objective: The Engagement Score metric assesses the overall engagement of a LinkedIn post by evaluating various parameters such as the clarity and relevance of the headline, effectiveness in grabbing attention, alignment with current industry trends, and relevance to the target audience. It also considers the depth and value of the information, clarity of the writing, use of examples and data, presence and effectiveness of a Call to Action (CTA), readability, and the inclusion of relevant media.

Required Columns in Dataset:

• Prompt: The original request or topic that led to the creation of the LinkedIn post.

• Content: The main body of the LinkedIn post.

• Response: The LinkedIn post generated by the model.

Score Range: 0 (low engagement) to 1 (high engagement)

Code Implementation

experiment_manager = Experiment(project_name="project_name",
                                experiment_name="experiment_name",
                                experiment_description="",
                                dataset_name="dataset_name")

response = experiment_manager.add_metrics(
    metrics=[
        {"name":"Engagement Score", "config": {"reason": True, "model": "gpt-4o-mini", "batch_size" : 5, "provider": "OpenAI"}}
    ]
)

print("Metric Response:", response)

Refer Executing tests page to learn about Metric Configurations

Example:

Prompt: Create a LinkedIn post about the importance of networking for career growth.

Content: Networking is important for career growth. Connect with people in your industry to build relationships and advance your career.

Response: Title: Networking Matters Networking is key to career growth. It helps you meet new people and create opportunities. Start connecting with others today!

Metric Score: Score: 0.3/1.0

Reasoning:

• Headline: The headline "Networking Matters" is generic and doesn't effectively capture attention or communicate the value of the content.

• Content Depth: The content is vague and lacks detailed insights or actionable advice on how to network effectively.

• CTA: The post includes a basic CTA ("Start connecting with others today!") that lacks specificity and doesn't inspire strong action.

• Relevance: While the topic is relevant, the post doesn't address specific challenges or scenarios, making it less impactful for the target audience.

• Readability: The post is very brief and does not make use of formatting options like bullet points or subheadings to improve readability.

Interpretation: The low score indicates that the LinkedIn post is not engaging enough due to its lack of depth, clarity, and a compelling CTA. For better engagement, the post should provide more valuable information, specific advice, and a stronger call to action, tailored to the needs and interests of the audience.