If you are using NHTSA's VIN decoder to get information regarding the U.S. Electric Vehicle Tax Credit, please refer to information released by the U.S. Department of Energy, U.S. Department of the Treasury and Internal Revenue Service, and these FAQs.
This tool is designed to solve a wide variety of codes and ciphers (currently 255 supported variations). To use this tool, enter the encrypted text in the box below along with any other relevant data (keywords, alphabets, numbers, etc) and it will attempt to solve it for you. See the FAQ below for more details.
This multi decoder is designed to support a large number of codes and ciphers. Not all codes and ciphers have keywords, alphabets, numbers, letter translation, etc so if the code or cipher doesn't require it, those fields will be ignored. If one does require something, the text of that box will be updated to tell you what it is missing in order to decode.
Typically you would put any keywords in the first Key/Alphabet box and any custom alphabets in the next one. If all you have are keywords or alphabets, try rotating the order just in case the cipher was coded with them switched.
If you find any tools that aren't working quite right, please reach out to me. It would be helpful if you provided as much information as you can and an example of how it should be.
Have you found something in this???
Even I want to use an encoder and decoder separately.
My task involves passing the tokenized input ids to the encoder and get the last_hidden_layer and then passing those embeddings to the decoder to get the tokens further decoding those tokens.
The benefit would be that it would reuse my type's init(from:Decoder) and encode(to:Decoder) methods and I wouldn't have to write similar things for CloudKit/CKRecord. I have another similar situation with local SQLite queries.
You do not strictly need to follow the model of JSONDecoder, which mostly provides just a top-level interface. The key thing for interacting with Codable types is to implement the Encoder and Decoder protocols with your own types that handle the low-level serialization and deserialization. You can write any kind of type you want as an interface on top.
They are not decoders, they are something else - they are what is referred to as a TopLevelDecoder, in that they are the thing that encapsulates the creation of decoders. It boils down to the transform concept from the input type (in this case Data) to a structured form (a type). The design reasons were sourced from needing a common form without needing associated types.
For reference Combine currently defines the concept of TopLevelDecoder, it was something we realized needs to be perhaps sunk a bit lower. It seems like something that belongs in the standard library.
@Philippe_Hausler @itaiferber Thanks for the background! Given your description of the difference in interface between a top-level coder and the Decoder protocol, could that be factored into a generic TopLevelDecoder type that implements the top-level container instantiation boilerplate, instead of having a separate type for every format with a new protocol trying to abstract over them?
Im not sure a generic on the decoder would be useful here, instead I think there should be a generic on the input since that is the smallest similar characteristic on decoders, likewise for the output for encoders.
Now I am not sure the implications of moving a protocol like that down, but I think if we can keep it the smallest delta from what exists it can serve both the purpose of servicing combine but also servicing other use cases too.
I can recommend the sample implementation of MessagePack coding by Flight School. It also comes with a book, that explains the details of Codable and how to write a custom Encoder/Decoder. I found this to be the most comprehensive resource on Codable yet.
In one of the generative AI courses, it is mentioned that GPT group of models are decoder only models which means it can generate text. I thought Q&A, translation and summarization type of task require an encoder-decoder model. So, how is GPT models able to do these task if they are only decoder models
The decoder, on the other hand, takes this encoded data and generates the output (such as a translated sentence in French). The decoder uses a mechanism called attention, which allows it to focus on different parts of the input when generating each part of the output.
GPT models, however, do not use an encoder. Instead, they are with a decoder-only architecture. This means that the input data is fed directly into the decoder without being transformed into a higher, more abstract representation by an encoder.
The decoder-only architecture simplifies the model and makes it more efficient for certain tasks, like language modeling. By removing the encoder, GPT models can process input data more directly and generate output more quickly. This architecture also allows GPT models to be trained on a large amount of unlabeled data, which is a significant advantage in the field of NLP where labeled data is often scarce.
Moreover, GPT models are trained using a method called unsupervised learning. They are trained to predict the next word in a sentence, given all the previous words. This training method allows GPT models to learn a lot about the structure and semantics of the language, which enables them to perform tasks like translation, summarization, and Q&A.
The answer is not strictly Q&A by AI - this is me providing significantly more context input to the AI than the length of the answer, along with instructions for the composition pieces desired, already knowing the topic (already answering the same before on Reddit), and re-composing the time-saving writing segments into the desired answer, including directly addressing the question.
Not necessarily, the answer is fine tuning, aka further training with smaller but highly curated datasets of text resembling the completion of these tasks, this works because of the process described by @_j
The OpenAI advancement is in not using tagged pre-prepared training that includes semantics, hyponymy, lemmatization, etc or an encoder to extract such abstractions, but simply pretraining on vast amounts of unlabeled data.
I am trying to wrap my head around how the Transformer architecture works. I think I have a decent top-level understanding of the encoder part, sort of how the Key, Query, and Value tensors work in the MultiHead attention layers. What I am struggling with is the decoder part, specifically the inputs to the very first decoder layer.
In the original paper in Figure 1, they mention that the first decoder layer input is the Outputs (shifted right). I am a little confused on what they mean by "shifted right", but if I had to guess I would say the following is happening
What is the need for shifting the sequence? Why would we not just input the target sequence itself? I was thinking maybe it's because of the auto-regressive nature of the decoder part, but then the only difference between the sequences would be the token if I am seeing this correctly.
Notice that the input to the decoder is the target sequence shifted one position to the right by the token that signals the beginning of the sentence. The logic of this is that the output at each position should receive the previous tokens (and not the token at the same position, of course), which is achieved with this shift together with the self-attention mask.
@Marco. - Eh? Do you mean your Browser to the INTERNET? I can see my I/O menu, and you can see mine in the Screengrabs I posted. No, I can't see the detailed Selection Down Menu in theat LINK you provided.
Omg thanks for this, I had no idea I had to make that change! Yeah mine was on Intel QSV setting as well, which is odd because I have an AMD Ryzen 1700 cpu. Made the switch to NVIDIA on that setting and presto, *much* faster decode and pans. Thank you!
I just Rendered a 1mins Media with a non-rendered NeatVideo + Mercalli treatment in 3mins. Wow... I could see the GPU being used in Task Manager and the CPU being left alone to get on with what it should.
@j-v - Actually, I was rather referring to the ancient DNA of the Vegas philosophy. Something has changed, something has. I supposed it started when, cough, cough, we got to liberate our GPU for Acceleration.
@j-v Actually, on this occasion, I was not attempting to be humorous, but rather making, I think, a valuable point regarding how the Engineers have released/loosened their grip on the code a little. This has meant them needing to work closely with, in my setup, with NVIDIA. In turn this has meant they are trusting us to make our decisions on how the NLE works. This will give them more options for us to make our own decisions.
I think we have that freedom because we are able to change settings, but I don't think that its good the developpers make the software as it installs now with the wrong settings, without to give at the start of the program the posibilities to make such a proper decision.
There are actually 2 settings in VP17 regarding enabling QSV encoding and decoding... one in file i/o and the other in general settings. The general settings one is also there in VP16. I didn't test all different combos but turned them on and off together when rendering in VP17... I imagine they'll remove the checkbox in general settings in the next VP17 update. Unchecking the box in file i/o adds about 10% to render times on my system (Asus motherboard with Intel iGpu) if source files are AVC encoded and output encoder is Mainconcept.
Wow, aren't more people mad about this? I'm really not understanding why I just found out? So for years I haven't been using my expensive NVIDIA card in Vegas because your system weirdly defaulted to Intel QSV?
b37509886e