Skip to main content

Table 3 BERTweet Embedding Extraction scenarios description

From: A BERTweet-based design for monitoring behaviour change based on five doors theory on coral bleaching campaign

Scenario Extracted Embedding
All 12 layers e1e12
Last layer e12
Last 4 layers e9e12
Last 2 layers e11e12
First 2 + Last 2 e1e2; e11e12
First + Last e1; e12
Last 2 + Mid 2 e11e12; e6e7
Last + Mid e12; e6