What are you looking for today?

Lewis, Nick (2024) AI and the Use of Drawing as a Natural Language. In: 15th International Conference on the Image, 24-25 Oct 2025, Buenos Aires. (Unpublished)

Full text not available from this repository. (Request a copy)

Abstract

Official URL: https://ontheimage.com/

Abstract

‘Prompt engineering’, whereby a user writes a text prompt to generate an image using AI, is a relatively new skill and relies on Natural Language Processing (NLP). The AI image generator, (DALL-E 3, Midjourney etc.) uses NLP to interpret the user’s requirements, and although initial results can be very effective, the more specific the requirements, the harder it can be to generate the desired result. Simple commands (‘A horse standing in a field’, for example), are easy to generate, but specific details, such as the actions of the horse and its placement in relation to other features, are harder for NLP to interpret, and can be hard to describe using text alone. In addition to this, the current generation of AI image generators cannot interpret the semiotic meaning of objects, (the systems could be said to ‘understand’ what something is, but not what it means). This requires the user to describe a scene or object that has semiotic meaning, using a semantic description. This paper investigates how a visual (drawing), rather than a written language can be more effective when using AI image generators and examines the implications of this for industry and education.

Item Type: Conference or Workshop Item (Lecture)
Depositing User: Nick Lewis
URI: https://sure.sunderland.ac.uk/id/eprint/18027

Further Details

More Information

Depositing User

Identifiers

Item ID
18027

Users with ORCIDS

ORCID for Nick Lewis

Catalogue record

Date Deposited
21 Jan 2025 13:54
Last Modified
03 Jun 2025 14:03

Actions (login required)

View Item (Repository Staff Only)