Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Code Project
  1. Home
  2. The Lounge
  3. Controversial: SQL

Controversial: SQL

Scheduled Pinned Locked Moved The Lounge
database
76 Posts 34 Posters 0 Views 1 Watching
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • R raddevus

    There is no good way to store good SQL queries for future use. Just, no good way. :rolleyes:

    U Offline
    U Offline
    User 10331519
    wrote on last edited by
    #29

    Just a thought: Use a library like JsonQL to convert SQL to a JSON representation and store them in MongoDB with descriptive metadata. Search on the content and/or metadata.

    R 1 Reply Last reply
    0
    • U User 13269747

      Quote:

      There is no good way to store good SQL queries for future use.

      What's wrong with stored procedures?

      R Offline
      R Offline
      raddevus
      wrote on last edited by
      #30

      Member 13301679 wrote:

      What's wrong with stored procedures?

      I mean like a development studio type of thing where you can select a particular SQL statement that you want to run manually when you're examining data and designing queries. We use SPs for all interactions with DB but I'm talking more about a code reuse type of thing. I guess I could create a library of SPs and then run those when I need to, but I'd still need a way to manage them with names and stuff so I could remember what they do. I guess it is really because I'm in the midst of designing queries for a large system and I only have to do this every 2 or 3 years so I have a long time away from it.

      U 1 Reply Last reply
      0
      • G Gaston Verelst

        How about [Solution Explorer - SQL Server Management Studio (SSMS) | Microsoft Docs](https://docs.microsoft.com/en-us/sql/ssms/solution/solution-explorer?view=sql-server-ver15) ?

        Check out my blog at http://msdev.pro/

        R Offline
        R Offline
        raddevus
        wrote on last edited by
        #31

        That does look good but...

        Link provided said

        Important This feature will be removed in a future version of Microsoft SQL Server. Avoid using this feature in new development work, and plan to modify applications that currently use this feature.

        G 1 Reply Last reply
        0
        • R raddevus

          Member 13301679 wrote:

          What's wrong with stored procedures?

          I mean like a development studio type of thing where you can select a particular SQL statement that you want to run manually when you're examining data and designing queries. We use SPs for all interactions with DB but I'm talking more about a code reuse type of thing. I guess I could create a library of SPs and then run those when I need to, but I'd still need a way to manage them with names and stuff so I could remember what they do. I guess it is really because I'm in the midst of designing queries for a large system and I only have to do this every 2 or 3 years so I have a long time away from it.

          U Offline
          U Offline
          User 13269747
          wrote on last edited by
          #32

          Quote:

          I mean like a development studio type of thing where you can select a particular SQL statement that you want to run manually when you're examining data and designing queries.

          MySQL Workbench allows that, including loading and saving the files just like an IDE, keeping files in different tabs, etc.

          R 1 Reply Last reply
          0
          • Richard DeemingR Richard Deeming

            Sounds like templates: Template Explorer - SQL Server Management Studio (SSMS) | Microsoft Docs[^]


            "These people looked deep within my soul and assigned me a number based on the order in which I joined." - Homer

            R Offline
            R Offline
            raddevus
            wrote on last edited by
            #33

            That's a good one. I'm checking it out. After looking at a couple of those templates I see where they got some of the boilerplate that they use in our RoundhousE[^] scripts. Thanks, I will look more closely at this one.

            1 Reply Last reply
            0
            • R raddevus

              That does look good but...

              Link provided said

              Important This feature will be removed in a future version of Microsoft SQL Server. Avoid using this feature in new development work, and plan to modify applications that currently use this feature.

              G Offline
              G Offline
              Gaston Verelst
              wrote on last edited by
              #34

              I didn't know that, thanks for the info. I have another one: [Download and install Azure Data Studio - Azure Data Studio | Microsoft Docs](https://docs.microsoft.com/en-us/sql/azure-data-studio/download-azure-data-studio?view=sql-server-ver15) Maybe this does what you want? I think it also works with SQL Servers that are not in Azure but I didn't test that.

              Check out my blog at http://msdev.pro/

              1 Reply Last reply
              0
              • D DumpsterJuice

                A lot of tools come to mind on this topic. Notepad, or Notepad++: I recommend using "AGENT RANSACK" a very fast multi-threaded Search engine. (You can start the search in your ROOT file for the SQL files) (Side note: This is my number one favorite tool) Organize the SQL files, by INDEXING Them (aka: "Tags") INDEX: (Example) #DATE Ex: 01/01/2021 #PROJECT Ex: (NAME) #TYPE Ex: (SELECT INSERT UPDATE DELETE) #NOTATION Ex: That query for the thing I had to do at 1AM ...more as needed ---------------------------------------------------------------- Open "Agent ransack" and search on terms in the sql. This could be all put in a database, but I think that may be a bit too much. You want something simple, and you want to find it fast. You already have a body of SQL that is not indexed. Start indexing all NEW SQL FILES, and as you revisit the old ones, (that are not indexed), Index them as you go along. Keep it all in one file, or multiple files, doesnt matter much with Agent Ransack. So what you wind up with is your very own Google Search for your sql. Keep It Simple, keep it moving.

                R Offline
                R Offline
                raddevus
                wrote on last edited by
                #35

                Interesting. I shall consider it.

                D 1 Reply Last reply
                0
                • U User 10331519

                  Just a thought: Use a library like JsonQL to convert SQL to a JSON representation and store them in MongoDB with descriptive metadata. Search on the content and/or metadata.

                  R Offline
                  R Offline
                  raddevus
                  wrote on last edited by
                  #36

                  This one gets my "programmer's mind" thinking about a lot of possibilities.

                  1 Reply Last reply
                  0
                  • R raddevus

                    There is no good way to store good SQL queries for future use. Just, no good way. :rolleyes:

                    B Offline
                    B Offline
                    Brian Battles
                    wrote on last edited by
                    #37

                    I find it handy to store them as pass-through queries in an MS Access database. You can give them names that work for you, and then sort them, filter them, search for them, etc. I also wrote a VBA function to let me search for any text string in all my Access queries in case I want to find which ones contain a certain table or field name and so on.

                    R 1 Reply Last reply
                    0
                    • R raddevus

                      There is no good way to store good SQL queries for future use. Just, no good way. :rolleyes:

                      E Offline
                      E Offline
                      ElectronProgrammer
                      wrote on last edited by
                      #38

                      For very special, or big, or being used a lot, queries (or for clients who can't spell SQL :-D ), I use something that you will probably hate. I use Java :) I make a program in Java (basically a custom SQL generator) where I insert the code inside a method that receives parameters that allow to configure the query in things like database/table/field names, which fields to return, insert sub-queries, etc. Then document with Javadoc as with any other program. All the queries are inside the same Java program, are selectable and configurable via command line or a web page that dynamically requests more configuration based on what you requested and configured so far. Using the generated Javadoc or an IDE on the program source makes it easy to find anything. The program makes easy to get the configured SQL. This has the advantage that you can tweak the Java source to add more functionality to the queries and make that selectable via parameters. You can even pass the program to clients and they will happily build some queries they need by just answering configuration questions and never touching SQL. I have done this for a client in the past in which the program would generate SQL and JavaScript (to interact with the SQL via web page) for their web site recommendation system using Similarity Matrices, Friends-of-Friends and a few other algorithms implemented in SQL. Since their recommendation system used the same algorithms to recommend different things (people, items, lists of people-item pairs, etc), this method was easier for me to maintain and they were very happy to be able to generate the required SQL in less than 5 minutes by answering a few questions instead of manually modifying each time the almost 500 lines of SQL code for the Similarity Matrix alone. They were even able to use the program by themselves, without requesting my help, to generate SQL to recommend things that were never mentioned to me. Unfortunately, I can not show any of those programs as they are protected by IP :( Yes, this is convoluted, but makes things easier on the long run.

                      R 1 Reply Last reply
                      0
                      • U User 13269747

                        Quote:

                        I mean like a development studio type of thing where you can select a particular SQL statement that you want to run manually when you're examining data and designing queries.

                        MySQL Workbench allows that, including loading and saving the files just like an IDE, keeping files in different tabs, etc.

                        R Offline
                        R Offline
                        raddevus
                        wrote on last edited by
                        #39

                        Looks interesting. I'm checking that one out. Looks similar to SSMS (Sql Server Mgmnt Studio)

                        1 Reply Last reply
                        0
                        • B Brian Battles

                          I find it handy to store them as pass-through queries in an MS Access database. You can give them names that work for you, and then sort them, filter them, search for them, etc. I also wrote a VBA function to let me search for any text string in all my Access queries in case I want to find which ones contain a certain table or field name and so on.

                          R Offline
                          R Offline
                          raddevus
                          wrote on last edited by
                          #40

                          This sounds like an interesting solution. I figured someone out there must be doing things like this. :thumbsup:

                          1 Reply Last reply
                          0
                          • R raddevus

                            Interesting. I shall consider it.

                            D Offline
                            D Offline
                            DumpsterJuice
                            wrote on last edited by
                            #41

                            A side benefit - I think you will really like Agent Ransack - as a bonus. I have used this tool for years. Its the one tool I cannot live without. You know you got the queries.. you just need help finding them. Comment them over time. Comment new ones when you make them. Then let Agent ransack do the work. Keep It Simple, keep it moving.

                            1 Reply Last reply
                            0
                            • E ElectronProgrammer

                              For very special, or big, or being used a lot, queries (or for clients who can't spell SQL :-D ), I use something that you will probably hate. I use Java :) I make a program in Java (basically a custom SQL generator) where I insert the code inside a method that receives parameters that allow to configure the query in things like database/table/field names, which fields to return, insert sub-queries, etc. Then document with Javadoc as with any other program. All the queries are inside the same Java program, are selectable and configurable via command line or a web page that dynamically requests more configuration based on what you requested and configured so far. Using the generated Javadoc or an IDE on the program source makes it easy to find anything. The program makes easy to get the configured SQL. This has the advantage that you can tweak the Java source to add more functionality to the queries and make that selectable via parameters. You can even pass the program to clients and they will happily build some queries they need by just answering configuration questions and never touching SQL. I have done this for a client in the past in which the program would generate SQL and JavaScript (to interact with the SQL via web page) for their web site recommendation system using Similarity Matrices, Friends-of-Friends and a few other algorithms implemented in SQL. Since their recommendation system used the same algorithms to recommend different things (people, items, lists of people-item pairs, etc), this method was easier for me to maintain and they were very happy to be able to generate the required SQL in less than 5 minutes by answering a few questions instead of manually modifying each time the almost 500 lines of SQL code for the Similarity Matrix alone. They were even able to use the program by themselves, without requesting my help, to generate SQL to recommend things that were never mentioned to me. Unfortunately, I can not show any of those programs as they are protected by IP :( Yes, this is convoluted, but makes things easier on the long run.

                              R Offline
                              R Offline
                              raddevus
                              wrote on last edited by
                              #42

                              I don't hate Java, actually. I really like Java as a language. Also, this sounds like the kind of thing that I was thinking might be going on out there -- custom solutions that help you design sql queries and manage them(for devs). :thumbsup:

                              E 1 Reply Last reply
                              0
                              • R raddevus

                                There is no good way to store good SQL queries for future use. Just, no good way. :rolleyes:

                                R Offline
                                R Offline
                                rnbergren
                                wrote on last edited by
                                #43

                                I am always late to the party. HAHAHA. But then I get to read everyone elses comments before I make my own. What I use is a blend of notepad++ or SSMS and multiple fairly large what I call scratch files. For differing companies and projects I create a scratch SQL project which is mostly commented out sql that includes databases, SPs, Views etc... and then one or 15 differing select statements/kewl sql statements that work for this database scheme. Then I use Agent Ransack when I am searching for something esoteric that I need for a new client/project. It works for me and I usually end up cobbling something together from inside the scratch file then copying and pasting into a new SQL for the new SP or View and away I go. What works for you I guess. PS I do love Agent Ransack.

                                To err is human to really mess up you need a computer

                                R 1 Reply Last reply
                                0
                                • R raddevus

                                  OriginalGriff wrote:

                                  I have sections in my text file ... because I'm lazy ...

                                  :thumbsup: That made me laugh too. I would like: 1) way to pick tables and fields (returned in query) 2) have notes that remind me what the query does 3) have a good way to find them again -- this wouldn't be easy to do I end up saving large SQL text files all over the place and then later searching through them and it takes just about as long to find them as it does to just think it all out again. I'm just wishing over here. :-D It would be very difficult to really create a good organizer. I guess I'm even lazier than I thought. (which I didn't think was possible)

                                  M Offline
                                  M Offline
                                  Matt Bond
                                  wrote on last edited by
                                  #44

                                  I use grepWin on windows to search the content of files. Has regex capabilities too. I use it all the time to find old SQL queries in our installer's collection of SQL files. The secret is to put all the text files in the same (root) folder. Bond Keep all things as simple as possible, but no simpler. -said someone, somewhere

                                  R 1 Reply Last reply
                                  0
                                  • R raddevus

                                    There is no good way to store good SQL queries for future use. Just, no good way. :rolleyes:

                                    R Offline
                                    R Offline
                                    Rusty Bullet
                                    wrote on last edited by
                                    #45

                                    My company uses SourceGear Vault Standard to store tables, stored procs, functions and queries, but I keep a folder of SQL named with a date and purpose. An example would be '20201201_RestoreDataForCustomer'. The date gives me a context to find them more quickly.

                                    R 1 Reply Last reply
                                    0
                                    • R raddevus

                                      There is no good way to store good SQL queries for future use. Just, no good way. :rolleyes:

                                      O Offline
                                      O Offline
                                      obermd
                                      wrote on last edited by
                                      #46

                                      Save them as .sql files and give them good file names. Then organize them into folders. In other words, treat them like any other application source code.

                                      R 1 Reply Last reply
                                      0
                                      • R Rusty Bullet

                                        My company uses SourceGear Vault Standard to store tables, stored procs, functions and queries, but I keep a folder of SQL named with a date and purpose. An example would be '20201201_RestoreDataForCustomer'. The date gives me a context to find them more quickly.

                                        R Offline
                                        R Offline
                                        raddevus
                                        wrote on last edited by
                                        #47

                                        Rusty Bullet wrote:

                                        An example would be '20201201_RestoreDataForCustomer'. The date gives me a context to find them more quickly.

                                        :thumbsup: That's one of the tricks I've employed too. but, it also seems to point to a problem that is begging for a management solution. Thanks

                                        1 Reply Last reply
                                        0
                                        • R raddevus

                                          There is no good way to store good SQL queries for future use. Just, no good way. :rolleyes:

                                          A Offline
                                          A Offline
                                          AndrewGT
                                          wrote on last edited by
                                          #48

                                          Why not store them in a database? You could use SQL to find the best match... :)

                                          R 1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Don't have an account? Register

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups