3/20/2024 0 Comments 6 lines 40 characters ascii art![]() This would enable them to learn the spatial relations between the numbers, first in 2D, then in 3D. And you tell them that if there is a row of characters 8 characters long, this means the ninth character will be right under the first character, the tenth right under the second, etc. This changes if we only use characters of equal width, and a square frame. With a bunch of the pics they produce, you notice they are basically off in the way you would expect if you didn’t know the width of individual characters. That entails so much information that is simply missing for them. Basically, if you were given an ASCII art in a string, but had no idea how the individual characters looked or what width they had, you would have no way to interpret the image.ĪSCII works because we perceive characters both in their visual shape, and in their encoded meaning, and we also see them depicting in a particular font with particular kerning settings. I think ASCII art in its general form is an unfair setup, though ChatGPT has no way of knowing the spacing or width of individual letters, that is not how they perceive them, and hence, they have no way of seeing which letters are above each other. This loss can affect the model’s ability to produce well-aligned ASCII art.įor this very reason, I was intrigued by the possibility of teaching them vision this way. Loss of formatting during preprocessing: When text is preprocessed and tokenized before being fed into the model, some formatting information (like whitespaces) might be lost or altered. ![]() This inconsistency makes it difficult for the model to learn a single, coherent way of generating well-aligned ASCII art. As a result, it struggles to maintain the correct alignment of characters in ASCII art, where spatial organization is essential.įormatting inconsistencies in training data: The training data for GPT-4 contains a vast range of text from the internet, which includes various formatting styles and inconsistent examples of ASCII art. Lack of spatial awareness: GPT-4 doesn’t have a built-in understanding of spatial relationships or 2D layouts, as it is designed to process text linearly. In case there is any doubt, here is GPT4′s own explanation of these phenomena: But given that it has been trained on a lot of ASCII art, it will probably be successful at copying some of it some of the time. ChatGPT really doesn’t see lines arranged vertically, it just sees the prompt as one long line. I think it makes sense that it fails in this way. Then I asked if it could do the Vitruvian Man as Ascii art, and it said: O
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |