Journal of Big Data

Table 3 BERTweet Embedding Extraction scenarios description

From: A BERTweet-based design for monitoring behaviour change based on five doors theory on coral bleaching campaign

Scenario	Extracted Embedding
All 12 layers	e₁ – e₁₂
Last layer	e₁₂
Last 4 layers	e₉ – e₁₂
Last 2 layers	e₁₁ – e₁₂
First 2 + Last 2	e₁ – e₂; e₁₁ – e₁₂
First + Last	e₁; e₁₂
Last 2 + Mid 2	e₁₁ – e₁₂; e₆ – e₇
Last + Mid	e₁₂; e₆

Back to article page