On May 4, 2010, at 11:03 AM, Nathan Jeffords wrote:
... We basically want one MCStreamer callback to correspond to one statement in the .s file. This makes it easier to handle from the compiler standpoint, but is also very important for the llvm-mc assembly parser itself.
> All fragments should be associated with a symbol. For assembler components, a
> unnammed "virtual" symbol can be used when there is no explicit label defined.
What do you mean by fragment? Can you give me an analogy with what the syntax looks like in a .s file, I'm not sure exactly what you mean here.
> Section assignment should be the responsiblity of the object imlementing the
> MCStreamer interface, with the caller givin the ability to give hints as to
> what section to place the symbol into.
Section assignment really needs to happen at a higher level. The TargetLoweringObjectFile interfaces are the ones responsible for mapping a global/function -> section. This interface (not mcstreamer) should handle this.
The important point here is that the COFF MCSection needs to have the right level of semantic information. In fact, MCSection is the place that I'd start for COFF bringup.
> instead of SwitchSection, there would be BeginSymbol, and SymbolSymbol, it would
> be illegal to call any EmitXXX function outside of these two calls
>
> BeginSymbol(Symbol, SectionHint)
> EmitAttribute(...)
> EmitAttribute(...)
> ...
> StartFragmentEmission()
> EmitFragment(...)
> EmitFragment(...)
> ...
> EndSymbol()
>
> Object file writers would typically start recording fragments and attributes for
> a symbol on the BeginSymbol, then at EndSymbol they would evaluate what was
> streamed, and decide what section the symbol should be placed in.
Why do you need this? This concept doesn't exist in the .s file, so I don't think that MCStreamer is the right level for this.
Global definitions like "int x;" are treated as common to allow
linking buggy programs that forget to use "extern" on declarations.
Somewhere I had got it in my head that global variables had static storage class by default. I guess I was wrong.
On May 5, 2010 2:45 PM, "Dale Johannesen" <da...@apple.com> wrote:
On May 5, 2010, at 2:32 PMPDT, Nathan Jeffords wrote:
>>
>> Global definitions like "int x;" are t...
Re having all fragments associated with some symbol -- this makes
sense if you think in high level terms and assume all symbols to be
some "objects". All data (fragments) you want to output is associated
with some "object" (symbol). However, that's probably too high level
thinking for MC interface. High level objects might not directly
correspond to object-file level symbols.
For example, module level
inline assembler does not correspond to any symbol, or function may
have more than one symbol when aliases are used.
Common is not .bss, it's an archaic concept inherited from Fortran. C
language specifies that global uninitialized variables are put into
common. This isn't for "programs that forget to use extern" -- you
can't get the same behaviour with extern, common variables are glued
together and with "normal" variables, so no object is exclusively owns
the variable. There's also some subtle difference when linking
archives.
On Wed, May 5, 2010 at 11:15 AM, Chris Lattner <clat...@apple.com> wrote:On May 4, 2010, at 11:03 AM, Nathan Jeffords wrote:
... We basically want one MCStreamer callback to correspond to one statement in the .s file. This makes it easier to handle from the compiler standpoint, but is also very important for the llvm-mc assembly parser itself.
This is an assumption I question. From an evolutionary perspective I agree; Given the existing code base I do see this as a logical transformation. As far as the assembly parser/streamer is concerned it certainly simplifies their implementations. But I also think that this interface could evolve in a direction that simplifies the common case (compiler -> object file) at a small expense to handling assembly language files.
> All fragments should be associated with a symbol. For assembler components, a
> unnammed "virtual" symbol can be used when there is no explicit label defined.
What do you mean by fragment? Can you give me an analogy with what the syntax looks like in a .s file, I'm not sure exactly what you mean here.I use the term fragment to refer to the MCFragment class and its derivatives. I understand that to mean any entity representing data in the final linked and loaded form. (something with an address)
> Section assignment should be the responsiblity of the object imlementing the
> MCStreamer interface, with the caller givin the ability to give hints as to
> what section to place the symbol into.
Section assignment really needs to happen at a higher level. The TargetLoweringObjectFile interfaces are the ones responsible for mapping a global/function -> section. This interface (not mcstreamer) should handle this.
The important point here is that the COFF MCSection needs to have the right level of semantic information. In fact, MCSection is the place that I'd start for COFF bringup.
OK, I see that now. The current isolation between TargetLoweringObjectFile -> MCStreamer -> MCObjectWriter has proven somewhat problematic, mostly due to my lack of understanding. I guess MCSectionXXX was meant to provide communication between them. Should the same be true of MCSymbol, and their data counterparts?
I had a problem with MCStreamer::EmitCommonSymbol & MCStreamer::EmitLocalCommonSymbol. When I implemented them I assumed this meant to put those symbols into the .bss segment. This required me to get a hold of the TLOF from the streamer. I now realize this is wrong after re-reading the description of the '.comm' directive a few times. I am not sure why an uninitialized global variable was being emitted using this, that seems wrong since global variables in different compilation units with the same name would get merged together at link time. (this is using clang on a C source file)
The logic to handle this has to go somewhere, putting it in the MCStreamer *implementation* that needs it is the most logical place. We also aim to implement an assembler, it doesn't make sense to duplicate this logic in the compiler and the assembler parser.
> All fragments should be associated with a symbol. For assembler components, a
> unnammed "virtual" symbol can be used when there is no explicit label defined.
What do you mean by fragment? Can you give me an analogy with what the syntax looks like in a .s file, I'm not sure exactly what you mean here.I use the term fragment to refer to the MCFragment class and its derivatives. I understand that to mean any entity representing data in the final linked and loaded form. (something with an address)Ok, MCFragment should definitely be formed behind the MCStreamer implementation. The .s printing implementation of MCStreamer, for example, has no use for it. With the current design, it would be a layering violation to make it earlier.
Yes somewhat. Currently, the COFF implementation of the assembler backend should maintain a DenseMap from MCSymbol* to whatever data you need to associate with a symbol. This is equivalent to embedding per-symbol stuff in the MCSymbol itself. MCSection should be subclassed and you should put COFF specific stuff in MCSectionCOFF.
As others have pointed out, this is one of the many horrors of C :)
The logic to handle this has to go somewhere, putting it in the MCStreamer *implementation* that needs it is the most logical place. We also aim to implement an assembler, it doesn't make sense to duplicate this logic in the compiler and the assembler parser.Assembly language has often been *the* intermediate form for between compilers and object files/executables, but I don't think its the most effective form. That said I have limited experience writing code generators so my opinions do not bear the wisdom of you and other developers of this library on this topic.
Yes somewhat. Currently, the COFF implementation of the assembler backend should maintain a DenseMap from MCSymbol* to whatever data you need to associate with a symbol. This is equivalent to embedding per-symbol stuff in the MCSymbol itself. MCSection should be subclassed and you should put COFF specific stuff in MCSectionCOFF.I think this is an important detail I was missing. I can already see how this will help with COMDAT sections. Is there any reason for the difference between symbol and section in this respect?
As others have pointed out, this is one of the many horrors of C :)Another reason why I am attempting to develop my own language. :)p.s. I posted my coff backend patch to llvm-commit, but that apears to be the wrong place, where should I have posted it?
Thanks! Funny, I was just preparing a patch to submit for my changes to MCSectionCOFF. My changes look to be fairly independent of yours, my change was to deal with COMDAT's. I had dealt with the characteristics flags in the object writer, but I like this. If you don't mind I would like to merge my changes into this patch and submit it. I was just pondering how to deal with the PrintSwitchToSection function without needing the IsDirective flag.
On Thu, May 6, 2010 at 11:12 PM, Peter S. Housel <hou...@acm.org> wrote:On Wed, 2010-05-05 at 13:22 -0700, Nathan Jeffords wrote:I'm enclosing my patch for reforming MCSectionCOFF to match the
>
> The important point here is that the COFF MCSection needs to
> have the right level of semantic information. In fact,
> MCSection is the place that I'd start for COFF bringup.
>
> OK, I see that now. The current isolation
> between TargetLoweringObjectFile -> MCStreamer -> MCObjectWriter has
> proven somewhat problematic, mostly due to my lack of understanding.
> I guess MCSectionXXX was meant to provide communication between them.
> Should the same be true of MCSymbol, and their data counterparts?
implementation strategy of the other two MCSection classes. You may find
it useful as a starting point. It seems to be complete and correct, and
worked for what I tried with it, but I didn't find time to test it fully
(e.g., by bootstrapping clang under Cygwin).
Cheers,
-Peter-
On Fri, May 7, 2010 at 12:05 AM, Chris Lattner <clat...@apple.com> wrote:
I prefer to merge in small independent patches as they are built. Please review Peter's patch (since you know COFF :). I'll take a look tomorrow and apply it if you think it is forward progress, and if there aren't other issues.On May 6, 2010, at 11:22 PM, Nathan Jeffords wrote:Thanks! Funny, I was just preparing a patch to submit for my changes to MCSectionCOFF. My changes look to be fairly independent of yours, my change was to deal with COMDAT's. I had dealt with the characteristics flags in the object writer, but I like this. If you don't mind I would like to merge my changes into this patch and submit it. I was just pondering how to deal with the PrintSwitchToSection function without needing the IsDirective flag.
Thanks!-ChrisOn Thu, May 6, 2010 at 11:12 PM, Peter S. Housel <hou...@acm.org> wrote:On Wed, 2010-05-05 at 13:22 -0700, Nathan Jeffords wrote:I'm enclosing my patch for reforming MCSectionCOFF to match the
>
> The important point here is that the COFF MCSection needs to
> have the right level of semantic information. In fact,
> MCSection is the place that I'd start for COFF bringup.
>
> OK, I see that now. The current isolation
> between TargetLoweringObjectFile -> MCStreamer -> MCObjectWriter has
> proven somewhat problematic, mostly due to my lack of understanding.
> I guess MCSectionXXX was meant to provide communication between them.
> Should the same be true of MCSymbol, and their data counterparts?
implementation strategy of the other two MCSection classes. You may find
it useful as a starting point. It seems to be complete and correct, and
worked for what I tried with it, but I didn't find time to test it fully
(e.g., by bootstrapping clang under Cygwin).
Cheers,
The reason for MCSectionCOFF etc., is that they are shared between the
MC and CodeGen interfaces. They have semantics that apply to both .s
files and object files, and even the frontend has some interest in
them.
OTOH, things like MCSymbolData, MCSectionData, are private to the
assembler backend, and so only the assembler and object writer need to
know about them (they are unused when writing to a .s file, for
example).
MCAssembler already maintains its own association of these data
structures, and there are a few bits available for the object file
backends inside MCSymbolData. I would be fine adding a few more for
use by specific object writers, if it simplifies your implementation.
I'm sorry I have had time to be very present on this thread, but
please feel free to mail me / ping me if there is a something about
the assembler backend you have questions on. I'm very excited to see
COFF support coming up!