WEB need a developer, be it LAMP or RoR

Discussion in 'OT Technology' started by biawokauns, Jun 6, 2008.

  1. biawokauns

    biawokauns New Member

    Joined:
    Sep 18, 2001
    Messages:
    19,893
    Likes Received:
    0
    Location:
    Republic of Kalifornia
    I need to scrape a website for data and save it to a database, use PHP or RoR it doesn't matter to me. I might do it myself but I'm pretty busy with work these days. Post up if you know WTF you're doing and an hourly, because most of you don't :rofl:

    Logik is my first choice, but he's drunk as fuck right now :mamoru:

    edit:

    oops, post some code snippets; show me how you'd parse some basic HTML or XML to usable data, as well as some prior work xp
     
  2. drumbandit

    drumbandit New Member

    Joined:
    Aug 14, 2003
    Messages:
    25,811
    Likes Received:
    0
    Location:
    South Point Poker Room - Table 11
    Steven Kovar - I design stuff. Check it out!

    Rates: $45/hr

    I will only book 2 clients at a time to retain optimal production speed and communication with them.

    EDIT: I have a partner now who can also offer the following:

    * C
    * C++
    * C#
    * Java
    * Python
    * PHP / MySQL
    * JSP
    * JavaScript/AJAX
    * ActionScript 2.0/3.0
    * HTML
    * XML
    * CSS
     
  3. biawokauns

    biawokauns New Member

    Joined:
    Sep 18, 2001
    Messages:
    19,893
    Likes Received:
    0
    Location:
    Republic of Kalifornia
    He has cool design work, but I don't need design. Additionally, I want a developer, not a contractor.
     
  4. intrktevo

    intrktevo New Member

    Joined:
    Oct 18, 2004
    Messages:
    5,781
    Likes Received:
    0
    Location:
    UCF
    where are you trying to pull what from in what format?
     
  5. drpepper

    drpepper Active Member

    Joined:
    Nov 13, 2006
    Messages:
    38,076
    Likes Received:
    2
    Location:
    San Antonio
    http://forums.offtopic.com/showthread.php?t=3819210
     
  6. Josh

    Josh Guest

    check PMs
     
  7. biawokauns

    biawokauns New Member

    Joined:
    Sep 18, 2001
    Messages:
    19,893
    Likes Received:
    0
    Location:
    Republic of Kalifornia
    Here's some more info:

    1. You will authenticate via basic HTTP authentication
    2. Start at UID 0, and increment up :)mamoru:)
    3. Pull data off the page and store it
    4. Additional step may require pulling another piece of data from a related page, and storing that.

    Example source:
    Code:
    <TABLE cellpadding="0" cellspacing="0" border="0" width="100%">
    <tr><td width="410">
    <span class="h1">Watermarke Apartments</span>
    
    
    </td>
    <td width="230" rowspan="8" valign="top"><div id='GroupResponse'></div>
    	<div id='GroupBeforeResponse' style="display:none"><br><span class="red">Adding . . . </span></div>
    	<div class="noprint" id="GroupButton441" style="display:none">
    	
    	<form action='/apart_base/Groups.INC.asp' name="GroupAdd" method='post' onsubmit="document.getElementById('GroupButton441').style.display = 'none';document.getElementById('GroupBeforeResponse').style.display = 'block'; new iframe(this, {multiple:true}); return false;">
    		<select onChange="this.form.GroupName.value = this.options[this.selectedIndex].value"  name="GroupNameOptions"><option value="Default">Choose Existing or </option><option value="market 50-99">market 50-99</option><option value="Near Rainier Continental">Near Rainier Continental</option><option value="owner managed">owner managed</option></select><input type="hidden" name="commandAdd" value="addOne">
    		<br>
    		<input type="text" name="GroupName" value="">
    		<br>
    		<input type="hidden" name="NiceName" value="Property">
    		<input type="hidden" name="AJAX" value="yes">
    		<input type="hidden" name="Response" value="GroupResponse">
    		<input type="hidden" name="BeforeResponse" value="GroupBeforeResponse">
    		<input type="hidden" name="ObjectID" value="441">
    		<input type="hidden" name="ObjectName" value="Property">
    		<input type="submit" name="add" value="Add to Property Group">
    		</form>
    		</div>
    
    </td>
    </tr>
    <tr><td>
    <span class="h2">52 Units</span>
    </td></tr>
    <tr><td height="6"></td></tr>
    <tr><td>
    4213  Stone Way North<br>Seattle, WA &nbsp;98103 
    </td></tr>
    <tr><td>
    (206)  632-5330
    </td></tr>
    </table>
    
    <br>
    <script type="text/javascript" src="/common/xfade2.js"></script>
    
    <table cellpadding="0" cellspacing="0" border="0" width="100%">
    
    
    
    <tr valign=top><td colspan="2" align="left" class="noprint">&nbsp;
    </td>
    </tr>
    <tr><td align="left" valign="top" width="400">
    
    <div id="imageContainer" style="display: none">
    <a href="Photo.asp?marketid=20&p=441&PhotoID=5892">
    <img border="0" src="/photos/Seattle/400x/5892.jpg">
    </a>
    
    <a href="Photo.asp?marketid=20&p=441&PhotoID=5893">
    <img border="0" src="/photos/Seattle/400x/5893.jpg">
    </a>
    
    <a href="Photo.asp?marketid=20&p=441&PhotoID=5894">
    <img border="0" src="/photos/Seattle/400x/5894.jpg">
    </a>
    </div>
    <div id="Psection441-1"  style="display: none" >
    <a href="Photo.asp?marketid=20&p=441&PhotoID=5892">
    <img border="0" src="/photos/Seattle/400x/5892.jpg">
    </a>
    </div>
    
    <div id="Psection441-2"  style="display: none" >
    <a href="Photo.asp?marketid=20&p=441&PhotoID=5893">
    <img border="0" src="/photos/Seattle/400x/5893.jpg">
    </a>
    </div>
    
    <div id="Psection441-3"  style="display: none" >
    <a href="Photo.asp?marketid=20&p=441&PhotoID=5894">
    <img border="0" src="/photos/Seattle/400x/5894.jpg">
    </a>
    </div>
    
    
    <div id="Psection441-All" style="display: none">
    
    <a href="Photo.asp?marketid=20&p=441&PhotoID=5892">
    <img border="0" width="198" src="/photos/Seattle/400x/5892.jpg">
    </a>
    
    <a href="Photo.asp?marketid=20&p=441&PhotoID=5893">
    <img border="0" width="198" src="/photos/Seattle/400x/5893.jpg">
    </a>
    
    <a href="Photo.asp?marketid=20&p=441&PhotoID=5894">
    <img border="0" width="198" src="/photos/Seattle/400x/5894.jpg">
    </a>
    
    </div>
    <script type="text/javascript"">
    	setPhotoDisplay('Psection441-1', '441')
    </script>
    
     
    
    
    </TD>
    
    <TD align="left" valign="top">
    
    <!-- Begin side info -->
    <TABLE cellpadding="0" cellspacing="0" border="0" width="100%"> 
    
    <!-- adds space between the pictures
    <tr><td rowspan="10" width="10">&nbsp;</td></tr>
    -->
    
    
    	<tr id="cusLink" class="noprint""><td>
    	<div class="besidePicture" id="customerLink">
    	<a onclick="document.getElementById('customerTR').style.display = 'block';document.getElementById('cusLink').style.display = 'none';return false;" href="#">Add</a>
    	</div>
    	</td></tr>
    
    	<tr id="customerTR" style="display:none"><td>
    	<div class="besidePicture" id="customer">
    	<span class="h2" id="cusTitle"><input id="cusTitleInput" type="Text" value="Contact"></span> <a class="noprint" href="#" onclick="displayNone('customer');"><img border="0" src="/images/remove10.jpg" width="10" height="10"></a>
    	<br>
    	<span id="cusText">
    	<input id="cusTextInput" type="Text" value="Steven Chattin<br>206-292-6098 ">
    	</span>
    	<input id="cusButton" type="Submit" name="add" value="Add" onclick="document.getElementById('cusText').innerHTML = document.getElementById('cusTextInput').value; document.getElementById('cusTitle').innerHTML = document.getElementById('cusTitleInput').value; document.getElementById('cusButton').style.display = 'none';document.getElementById('cusButton2').style.display = 'none';"><input id="cusButton2" type="reset" name="reset" value="Clr" onclick="document.getElementById('cusTitleInput').value = ''; document.getElementById('cusTextInput').value = '';">
    	</div>
    	</td></tr>
    
    
    
    	<tr><td>
    	<div class="besidePicture" id="owner441">
    	<span class="h2">Owner</span> 
    	<img class="noprint" border="0" src="/images/remove10.jpg" width="10" height="10" onclick="displayNoneRegExp('owner');">
    	<br>
    	<a href="/MoS/Subscribers/Enterprise2_Results.asp?marketid=20&ownerid=161">Roberts, Stanley A. & Rebecca M.</a><br>Stanley A. Roberts<br>3618 West Mercer Way  <br>Mercer Island, WA &nbsp;98040<br>(206)  236-1443
    	</div>
    	
    	</td></tr>
    
    	<tr><td>
    	<div class="besidePicture" id="manager441">
    	<span class="h2">Manager</span>
    	<img class="noprint" border="0" src="/images/remove10.jpg" width="10" height="10" onclick="displayNoneRegExp('manager');">
    	<br>
    	<a href="/Mos/Subscribers/Manager2_Results.asp?marketid=20&MgmtCoID=19">Cornell & Associates</a><br>Blake Cornell<br>2633  Eastlake Avenue East  #307<br>Seattle, WA &nbsp;98102<br>(206)  329-0085
    	</div>
    	</td></tr>
    
    <tr><td>
    
    <div class="besidePicture" id="rating1441">
    <span class="h2">Property Rating</span>
    <img class="noprint" border="0" src="/images/remove10.jpg" width="10" height="10" onclick="displayNoneRegExp('rating1');">
    
    	<table border="0" cellpadding="0" cellspacing="0">
    	<tr><td>Improvements &nbsp;
    	</td> <td> B+</td></tr>
    	</td></tr><td align="left">
    	<tr><td>Location</td>  <td>B+</td></tr>
    	</table>
    	</div>
    
    </td></tr>
    
    
    
    	<tr><td>
    	<div class="besidePicture" id="statusdate441">
    	<span class="h2">Completion Date</span>
    	<img class="noprint" border="0" src="/images/remove10.jpg" width="10" height="10" onclick="displayNoneRegExp('statusdate');">
    <br>
    	January, 1989
    
    	<tr><td>
    	<div class="besidePicture" id="priorname441">
    	<span class="h2">Prior Name(s)</span>
    	<img class="noprint" border="0" src="/images/remove10.jpg" width="10" height="10" onclick="displayNoneRegExp('priorname');">
    	<br>
    	Watermark at Wallingford, The<br>
    	</div>
    	</td></tr>
    
    
    
    </table> <!-- END of the side table --->
    
    </td></tr>
    
    </table> <!---END of the photo and side table thing--->
    
    <br>
    
    <span id="propcomp441">
    <TABLE border="0" cellpadding="0" cellspacing="0" width="100%">
    <tr align="center">
    <td align="Left">
    <span class="h2">Property Composition</span>  <img class="noprint" border="0" src="/images/remove10.jpg" width="10" height="10" onclick="displayNoneRegExp('propcomp');"></td>
    <td align="right" class="noprint">&nbsp;</td>
    </tr>
    </table>
    
    
    
    <div id="expand441">
    <table width="100%" border="0"><tr><td colspan="7" align="right"><small>Survey Year: 2008 Type: 1</small></td></tr><tr align="center" valign="bottom"><td rowspan="2" align="left"><u>Unit Type</u></td><td rowspan="2">No. of<br><u>Units</u></td><td colspan="2"><u>Size (Sq. Ft.)</u></td><td colspan="2"><u>Actual Rate</u></td></tr><tr align="center"><td>Unit</td><td>Total</td><td>Total</td><td>Sq. Ft.</td></tr><tr><td colspan="7"><hr noshade></td></tr><tr valign="top" align="center"><td align="left">Studio</td><td>10</td><td>601</td><td>6,010</td><td>$950</td><td>$1.581</td></tr><tr valign="top" align="center"><td align="left">One Bedroom</td><td>32</td><td>700</td><td>22,400</td><td>$1,050</td><td>$1.500</td></tr><tr valign="top" align="center"><td align="left">Two Bedroom/Two Bath</td><td>6</td><td>826</td><td>4,956</td><td>$1,300</td><td>$1.574</td></tr><tr valign="top" align="center"><td align="left">Three Bedroom/Two Bath</td><td>4</td><td>1,288</td><td>5,152</td><td>$1,595</td><td>$1.238</td></tr><tr><td colspan="7"><hr noshade></td></tr><tr align="center"><td align="left">Total/Average</td><td>52</td><td>741</td><td>38,518</td><td>$1,102</td><td>$1.487</td></tr></table>
    </div>
    
    <div id="collapse441" style="display:none;">
    <table width="100%" border="0"><tr><td colspan="7" align="right"><small>Survey Year: 2008 Type: 1</small></td></tr><tr align="center" valign="bottom"><td rowspan="2" align="left"><u>Unit Type</u></td><td rowspan="2">No. of<br><u>Units</u></td><td colspan="2"><u>Size (Sq. Ft.)</u></td><td colspan="2"><u>Actual Rate</u></td></tr><tr align="center"><td>Unit</td><td>Total</td><td>Total</td><td>Sq. Ft.</td></tr><tr><td colspan="7"><hr noshade></td></tr><tr valign="top" align="center"><td align="left">Studio</td><td>10</td><td>601</td><td>6,010</td><td>$950</td><td>$1.581</td></tr><tr valign="top" align="center"><td align="left">One Bedroom</td><td>32</td><td>700</td><td>22,400</td><td>$1,050</td><td>$1.500</td></tr><tr valign="top" align="center"><td align="left">Two Bedroom/Two Bath</td><td>6</td><td>826</td><td>4,956</td><td>$1,300</td><td>$1.574</td></tr><tr valign="top" align="center"><td align="left">Three Bedroom/Two Bath</td><td>4</td><td>1,288</td><td>5,152</td><td>$1,595</td><td>$1.238</td></tr><tr><td colspan="7"><hr noshade></td></tr><tr align="center"><td align="left">Total/Average</td><td>52</td><td>741</td><td>38,518</td><td>$1,102</td><td>$1.487</td></tr></table>
    </div>
    
    </span>
    
    <!--
    <div id="expand">
    <tr>
    <td colspan="3"></td>
    </tr>
    </div>
    
    <div id="collapse" style="display:none;">
    <tr>
    <td colspan="3"></td>
    </tr>
    </div>
    
    </table>
    >
     

Share This Page