Illustration of two types of model architectures for VLP (IMAGE)

Beijing Zhongke Journal Publising Co. Ltd.

Illustration of two types of model architectures for VLP

Caption

The single-stream architecture refers to that the text and visual features are concatenated together, then fed into a single transformer block, as shown in Fig. 1(a). The dual-stream architecture refers to that the text and visual features are not concatenated together but sent to two different transformer blocks independently, as shown in Fig. 1(b).

Credit

Beijing Zhongke Journal Publising Co. Ltd.

Usage Restrictions

Credit must be given to the creator.

License

CC BY

Disclaimer: AAAS and EurekAlert! are not responsible for the accuracy of news releases posted to EurekAlert! by contributing institutions or for the use of any information through the EurekAlert system.